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Description 



Method and arrangement for determining parameters of a 
technical system 

5 The invention relates to a method and an 

arrangement for determining parameters of a technical 
system. 

During multichannel transmission and 

multichannel reception of signals, interference 

10 frequently occurs, for example, between the 
signals/images. One typical example in this case is 
mixing of a voice signal with noise, which can present 
a major problem in telecommunications and in video 
conferences. The present invention thus relates to the 

15 field of signal separation in order, for example, to 
recover an original voice signal . 

Typical known techniques for separation of 
source signals based on mixed signals are based on time 
averaging or filtering of the signals. This 

20 intrinsically has disadvantages in terms of the 
computation complexity. 

Methods based on so-called blind channel 
equalization (signal equalization without prior 
knowledge of the transmission channel) are also known, 

2 5 but these methods always require a certain amount of 
knowledge about the source signals, such as knowledge 
about their statistical distribution. 

The problem of signal separation also occurs, 
for example, when two speakers are speaking into two 

30 microphones positioned at a distance from one another, 
so that each microphone receives a mixture of the 
signals spoken by the two speakers. The problem thus 
arises of separating the signal mixture once again, 
that is to say of separating a set of superimposed 

35 input signals. L. Molgedey, H.G. Schuster, "Separation 
of a Mixture of Independent Signals using Time-Delayed 
Correlations", Phys . Ref . Lett. 72, 3634 (1994) in this 
case discloses the following method: the problem of 
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separating n superimposed and correlated source signals 
(input signals) and at the same time of establishing 
mixing coefficients of the source intensities can be 
reduced to an intrinsic value problem, in which two 
5 symmetrical n x n matrices must be diagonalized 
simultaneously. The matrix elements are measurable 
time-delayed correlation functions. This intrinsic 
value problem can be solved by means of a neural 
network, in which case the learning rules for the 
10 lateral inhibiting interactions between the neurons can 
be established by means of a Liapunov function whose 
minima provide the (degenerate) solutions to the 
problem. 

This method has also already been applied to 
15 the acoustic input signals (see F. Ehlers, 
H.G. Schuster, "Blind Separation of convolutive 
mixtures and an application in automatic speech 
recognition", IEEE Trans. Signal Proc . (1997). 

DE 195 31 388 CI discloses a signal separation 
2 0 method and a signal separation device for nonlinear 
mixtures of unknown signals (blind channel), which is 
illustrated schematically in Figure 3 . 

This German Patent relates to the separation of 
a signal mixture comprising the nonlinear 

2 5 superimposition of M unknown source signals XI, X2 , 

where N (N > M) different mixtures of M source signals 
XI, X2 including any interference signal which may be 
present are supplied to a signal evaluation device, 
which analyzes the signal statistically to establish 

3 0 the nonlinear transmission factors and using these 

calculated factors to reverse the mixing process, so 
that the N outputs of the signal separation device 
contain, as approximately as possible, the M source 
signals without superimposit ions . 
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It thus becomes possible to treat nonlinear mixtures, 
in which the case the term nonlinear means that the 
source signals XI, X2 are mixed by means of an unknown 
nonlinear system G. The unknown system G is described 
5 by a so-called Volterra series, and the signal 
separation device G-1 establishes the coefficients in 
the Volterra series. Once this 
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SUBSTITUTE SPECIFICATION 

TITLE OF THE INVENTION 

System for determining parameters of a technical system 

5 BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The invention relates to a method and system for determining parameters of a technical 

system. 

10 DESCRIPTION OF THE RELATED ART 

During multichannel transmission and multichannel reception of signals, interference 
frequently occurs, for example, between the signals/images. One typical example in this case 
is mixing of a voice signal with noise, which can present a major problem in 
telecommunications and in video conferences. The present invention thus relates to the field of 

15 signal separation in order, for example, to recover an original voice signal. 

Typical known techniques for separation of source signals based on mixed signals are 
based on tune averaging or filtering of the signals. This intrinsically has disadvantages in terms 
of the computation complexity. 

Methods based on so-called blind chaimel equalization (signal equalization without 

20 prior knowledge of the transmission channel) are also known, but these methods always 

require a certain amount of knowledge about the source signals, such as knowledge about their 
statistical distribution. 

The problem of signal separation also occurs, for example, when two speakers are 
speaking into two microphones positioned at a distance from one another, so that each 

25 microphone receives a mixture of the signals spoken by the two speakers. The problem thus 
arises of separating the signal mixmre once again, that is to say of separating a set of 
superimposed input signals, L. Molgedey, E.G. Schuster, "Separation of a Mixture of 
Independent Signals using Tune-Delayed Correlations", Phys. Ref. Lett. 72, 3634 (1994) in 
this case discloses the following method: the problem of separating n superimposed and 

30 correlated source signals (input signals) and at the same time of establishing mixing 



coefficients of the source intensities can be reduced to an intrinsic value problem, in which two 
symmetrical n x n matrices must be diagonalized simultaneously. The matrix elements are 
measurable time-delayed correlation functions. This intrinsic value problem can be solved by a 
neural network, in which case the learning rules for the lateral inhibiting interactions between 
5 the neurons can be established by a Liapunov function whose minima provide the (degenerate) 
solutions to the problem. 

This method has also already been applied to the acoustic input signals (see F. Ehlers, 
H.G. Schuster, "Blind Separation of convolutive mixtures and an application in automatic 
speech recognition", IEEE Trans. Signal Proc. (1997). 
10 DE 195 31 388 CI discloses a signal separation method and a signal separation device 

for nonlinear mixmres of unknown signals (blind channel), which is illustrated schematically in 
Figure 3 . 

This German Patent relates to the separation of a signal mixture comprising the 
nonlinear superimposition of M unknown source signals XI, X2, where N (N > M) different 

15 mixmres of M source signals XI, X2 including any interference signal which may be present 
are supplied to a signal evaluation device, which analyzes the signal statistically to establish the 
nonlinear transmission factors and using these calculated factors to reverse the mixing process, 
so that the N outputs of the signal separation device contain, as approximately as possible, the 
M source signals without super impositions. 

20 It thus becomes possible to treat nonlinear mixtures, in which case the term nonlinear 

means that the source signals XI, X2 are mixed by an unknown nonlinear system G. The 
unknown system G is described by a so-called Volterra series, and the signal separation device 
G-1 establishes the coefficients in the Volterra series. Once this is known, it is possible to 
unmix the signal mixtore. Furthermore, the coefficients can be used for further analysis in 

25 order to determine the position or speed of the signal sources. 

The method which is known from this document in this case essentially comprises two 

steps: 

Firstly, the nonlinear equations which are selected uniquely by the selectable degree of 
nonlinearity in the mixing process are solved by a sliding time window, and the solutions are 



averaged over this time. This time averaging process represents a major disadvantage of this 
known technique, since it increases the computation complexity, while at the same time 
increasing the time required for the calculation process. 

Secondly, the potential formed from a sufficiently large number of different cumulants 
5 of the estimated output signals is minimized, with the values required to calculate the potential 
originating from a sliding time window whose length can be varied. In this case, it is assumed 
that the mixing system varies sufficiently slowly that this change can be ignored in the 
calculation of the sought mixing factors. According to this German Patent, the second said step 
is carried out by constructing and minimizing a cost function. When the global minimum is 
10 reached, the optimum values, in this case the transmission factors, have been found. 

With regard to the time involved and the computation complexity, the method described 
in DE 195 31 388 CI is disadvantageous, since the tune averaging process has to be carried 
out at the end of the first method step mentioned above. 

15 SUMMARY OF THE INVENTION 

The present invention is thus based on the object of providing a method and system 
which allow the separation of superimposed, statistically mutually independent, acoustic 
signals with reduced computation complexity. 

This object is achieved by a method for determining parameters of a technical system 
20 by determining output signals from a set of superunposed, statistically mutually independent 
input signals. The parameters are determined in such a manner that the statistical 
independence of the output signals is maximized. 

A system for determining parameters of a technical system, in which output signals can 
be determined from a set of superunposed, statistically mutually independent input signals, has 
25 a processor that determines the parameters m such a manner that the statistical independence of 
the output signals is maximized. The parameters are preferably determined using an iterative 
method. 

In a further refinement, the parameters are elements in an unmixing matrix, by which 
the set of superimposed input signals is multiplied or else convoluted, by which the output 
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signals are formed. The optimization of the parameters in the unmixing matrix is preferably 
obtained by the following steps: 

- repetition of a tune-delayed decorrelation calculation in order to determine the 
intrinsic values in the unmixing matrix, 

5 - determination of the intrinsic values in the unmixing matrix for which cross- 

correlations assume a minimum value, and 

- carrying out cumulant minimization, with the intrinsic values determined in the 
previous step being used as start values for the cumulant minimization. 

The cumulant minunization can be used, for example, by training a neural network, or 
10 else by any other known minimization technique, such as gradient descent or Monte Carlo 
simulations. 

In one development, at least one diagonal parameter of the unmixing matrix is set to a 
predetermined value during the optimization of the parameters in the unmixing matrix, thus 
ensuring the stability of the minimization process with respect to a global minimum. 
15 The unmixing matrix is preferably limited to a finite impulse response, that is to say an 

FIR mter (Finite Impulse Response) is used to form the individual components of the unmixing 
matrix. The FIR fiher may be either a causal FIR filter or else a non-causal FIR filter. 

Furthermore, the unmixing matrix is preferably stabilized by projection on to a unit 
circle during the cumulant minimization process. 
20 The developments apply not only to the method but also to a system in which a 

processor is set up in such a manner that the method can be carried out. 

The invention and its developments can advantageously be used for separation of 
superimposed, statistically mutually independent input signals, in particular acoustic input 
signals. 

25 The method and the system can be used for any desired number of input signals. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and advantages of the present invention will become more 

apparent and more readily appreciated from the following description of the preferred 

embodiments, taken in conjunction with the accompanying drawings, in which: 
5 Figure 1 shows the use of a system for separation of superimposed, statistically 

mutaally independent acoustic signals according to the exemplary embodiment, 
Figure 2 shows a schematic illustration of the system from Figure 1, and 
Figure 3 shows a signal separation device, which is known from the prior art (DE 195 

31 388 CI), for nonlinear mixtures of unknown signals. 

10 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference will now be made in detail to the preferred embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings, wherein like 
reference numerals refer to like elements throughout. 

15 The statistical independence between the source signals (the original voice signal and 

the noise), also referred to as input signals in the following text, is used to recover the original 
voice signal from a mixmre of signals, and the inverse process to that of the dynamic system, 
which has resulted in the mixing of the signals, is trained essentially approximately (is learnt). 
Two different mixmres of the voice signal and of the noise signal are obtained, for example, 

20 by two microphones 1, 2 (see Figure 1) which are at a distance from one another and/or are 
aligned in opposite directions. The so-called time-delayed decorrelation technique (TDD) is 
used to initiate the learnmg phase in the method, that is to say in order to determine and 
specify start values for the learning phase, which allows the computation complexity for 
cumulant minimization as described in the following text to be reduced, and allows the risk of 

25 local minima to be reduced. 

Figure 1 shows two microphones 1,2, which pick up a first input signal Zl(t) and a 
second input signal Z2(t). These input signals Zl(t) and Z2(t) can in mrn each be mixed with 
one another and with noise, as is represented symbolically by a mixing mattix S (see reference 
symbol 3) in Figure 1. After reception and/or transmission, a set Xl(t) and X2(t) of 
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superimposed, statistically mutually independent input signals Zl(t) and Z2(t) is obtained. 
These signals are entered in a calculation unit 4, in which essentially two steps are carried out, 
as is represented symbolically by a calculation unit B (reference symbol 6) for the first step 
and a neural network 5 for the second step. 

5 The calculation unit 4 determines two output signals Yl(t) and Y2(t), respectively, 

which are approximately equal to the input signals Zl(t) and Z2(t), respectively, when the 
parameters are set optunally in the calculation unit 4. In other words, when the parameters of 
the matrices which are used are set optimally in the calculation unit 4, this calculation unit 4 
essentially carries out the inverse process to that of the dynamic mixing process, which is 

10 represented symbolically by the matrix S (reference symbol 3). The exemplary embodiment 
relates to the optimization process for setting the parameters for the unmixing matrix. 

The parameters of the matrices in the calculation unit 4 are in this case optimized such 
that the statistical independence between the output signals Yl(t), Y2(t) obtained by the matrix 
process in the calculation unit 4 is maximized. To this end, the output signals Yl(t) and Y2(t), 

15 respectively, are fed back to the calculation unit 4 (see the feedback loops 7 and 8, 

respectively). An iterative method is used to determine whether the statistical independence of 
the output signal YI(t) and Y2(t), respectively, has increased in comparison to the previous 
iteration step (so that the iteration is in the "right" direction, in the direction of the global 
minimum of a cost function, which will be described in the following text). 

20 Figure 2 shows a mathematical representation of the layout from Figure 1 , in which 

case the mixing process 3 can be described mathematically by a matrix S(q), and the unmixing 
process, which is intended to be carried out by the calculation unit 4, is symbolized by an 
unmixing matrix M(q). 

Figure 2 thus illustrates the problem of separation of a so-called multichannel blind 

25 source (multiple channel source without a-priori knowledge) into two dimensions. In this case, 
it is assumed that the mixing system S(q), where q represents a unit delay, is stable and, at the 
same time, also has a stable inversion, that is to say it is a mimmal phase system. 
Furthermore, it is assumed that the input signals Zl(t) and Z2(t) (for example a voice signal 
and a noise signal) are statistically mutually independent and do not have a Gaussian 
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distribution. The sets Xl(t) and X2(t) of superimposed input signals Zl(t) and Z2(t) are input 
signals to an unmixing system having an unmixing matrix M(q) whose parameters (matrix 
elements) are trained to maximize the statistical independence between the output signals Yl(t) 
and Y2(t). In this case, the term "training" means the well known learning process of, for 
5 example, a neural network, which should be cited as an example of a technique to maximize 
the statistical independence. This is done by minimizing a cost function J(M), which will be 
described further below. 

A cumulant cost function is formed, which minimizes the diagonal cumulant elements 
of the cumulant order 2-4: 

10 Dcum«J(M)= 2 2 

i=lnondiag 

The following aspects of dynamic mixing by the mixing matrix S(q) need to be taken 
into account in this case: 

- Stability of the unmixing system: 

15 This is achieved by limiting M(q) to a finite impulse response (FIR filter). The stability 

of the FIR system M(q) can, furthermore, also be obtained by carrying out a projection on to a 
unit circle during the learning phase. Any non-causality of the inversion of S(q) which may be 
present can be compensated for by a suitable time shift (delay) to the input signal X(t). 

- Uniqueness of the separated signals Y(t): 

20 In the case of steady-state mixing processes, the original source signals are recovered 

by scaling. For dynamic unmixing, the risk of the separated signals Y(t) not being unique is 
even greater. It is obvious that, in the situation where Yl(t) and Y2(t) are statistically mutually 
independent, any linear-filtered modification of these signals will also still be statistically 
independent. Additional information is therefore required in order to reduce the inherent 

25 ambiguity of the problem. 
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- Gaussian deformation of the data: 
Algorithms on a cumulant basis for steady-state blind source separation effectively 
minimize or eluninate higher-order diagonal cumulants corresponding to the output signals 
Y(t). On the other hand, linear filtering leads to the data being deformed to a Gaussian 
5 distribution, with the higher-order cumulants moving in the 0 direction. This can thus lead to 
limit solutions, in which the cost function reaches local mimmum, but with the desired acmal 
separation (global minimum) not being achieved. In order to avoid this undesirable situation, 
the structure of the unmixing transfer function (unmixing matrix) M(q) is subject to a number 
of lunitations. 

10 In order to avoid the abovementioned problems, an approach is chosen in which at least 

one (or else all) of the diagonal elements is or are set to the unit value: 
Mll(q) = 1 andM22(q) = 1. 

This assumption is exact if the mixing elements Sll(q) and/or S22(q) likewise have a 
unit value "1". Otherwise, it is assumed that Sll(q) and/or S22(q) have stable inversions, 

15 which allows the diagonal elements to be scaled from M(q) to the unit value. This approach 
considerably reduces the ambiguity of a solution and, furthermore, effectively avoids the risk 
of excessive Gaussian-distribution deformation of the output signals. Even if, as stated above, 
the limitation to the diagonal elements of M(q) is at first glance to be highly restrictive, this 
assumption is generally satisfied m practical use. One typical example is the removal of noise 

20 from voice signals on the basis of a recording using two microphones, with the microphones 
being physically separated from one another or one microphone pointing in the direction of the 
speaker, while the other microphone points in the opposite dhection, so that the second signal, 
facing away from the speaker, essentially includes only a noise signal. 

The cumulant approach is based on the direct determination of the diagonal cumulant, 

25 as is stated in the article mentioned initially by F. Ehlers and H. Schuster, "Blind Separation of 
convolutive mixmres and an application in automatic speech recognition", IEEE Trans. Signal 
Proc. (1997), although this inherently has the disadvantage that numerical solution is highly 
complex. Suitable initialization is thus used for this minimization method. In order to 
determine start values for the minunization method, the present invention uses the technique of 
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time-delay decorrelation (TDD) for simultaneous decorrelation of two different time delays, in 
which case this TDD technique can be based on a suitable matrix intrinsic-value problem. As 
already stated, this TDD technique is used according to the present invention for initiation of 
the diagonal (cross-correlation) cumulant minimization problem. 
5 In summary, the method can be subdivided into the two following steps: 

1 . Repetition of the TDD method on the basis of the intrinsic-value problem in the 
frequency domain for different delay pairs and determination of that solution for which the 
cross-correlation terms have a minimum value. 

2. Initiation (start) of the diagonal cumulant minimization process on the basis of the 
10 start values (FIR parameters) determined in the above step. 

A number of major characteristics and advantages will be summarized once again in the 
following text: 

- No a-priori knowledge of the signal characteristics is required, with the exception of 
the necessity for statistical independence. 

15 - The stability of the dynamic unmixing system is ensured by the modulation of its 

components as an FIR filter. 

- Excessive Gaussian distribution deformation is avoided by the approach of at least one 
of the elements in the mixing transfer function matrix (unmixing matrix) being set to the unit 
value, or being able to be scaled to the unit value, and 

20 - since the cumulant minimization step (step 2) requires a large amount of computation 

complexity, the learning algorithm, for example of a neural network, is initialized using the 
TDD method. 

The following text contains a program in Matlab, e.g. Version 4, by which the 
exemplary embodiment described above can be implemented on a computer: 

25 

function { cost, out l,out2 ] } =cumulant_costFIRa2(par,input,pl,pll,p2,p22,a3,a4); 
% { cost,outl,out2 ] } =cumulant_costFIRa2(par,input,pl,pll,p2,p22,a3,a4); 
% cumulant cost 
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% FIR representation used 

% filter function used in both directions (non_causal) 

{ np,mp ] } =size(par); 
5 firl=par(l:pl); 

firll=par(l+pl:pl+pll); 
fir2=par(l +pl +pl 1 :pl +pl 1 +p2); 
fir22=par(pl +pl 1 +p2+ 1 :mp); 

den=l; %FIRonly 

10 

outl= { input(:;l)-filter(firl,den,input(:,2))-flipud(filter( { 0 firll ] } , { den ] } 
,flipud(input(:,2))))]}; 

%/std(input(l,:)); %dlsim 

% filter 

15 out2= { input(:,2)-filter(fir2,den,input(:,l))-flipud(filter( { 0 fir22 ] } , ] } {den], 
flipud(input(:,l))))] } ;%/std(input(:,2)); 

%dlsim %filter 

out { outl out2 ] } ; 

%outl=outl/std(outl); % this scaling was not needed in examples in SIP98 paper 
20 %out2=out2/std(out2); 

Ld=0; % number of delays in calculating the cross-correlation 
costs =0; 
cost4=0; 
25 costALLl = { ] } ; 
costALL2= { ] } ; 
ol2=outl.*out2; 
cost2=mean(o 12)^2; 
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on2=outl.*outl.*out2; 
ol22 = outl.*out2.*out2; 

ifa3 = = 1 

5 costs = { mean(ol22) ] } ^2+ { mean(ol22) ] } ^2; 

end 

if a4 = = 1 

10 cost4= { mean(oll2.*outl)-3*mean(outl.^2)*mean(ol2) ] } ^2 + ... 

{ mean((outl M) . *(out2. ^2))-2*mean(ol2)^2- 
mean(outl.^2)*mean(out2.^2) ] } ^ + ... 
{ mean(ol22.*out2)-3*mean(out2.^2)*meaii(ol2) ] } ^2; 
end 

15 

%cum4a= { cum4x(outl,outl,outl,outl) ] } ^2; 
%cum4b= { cum4x(out2,out2,out2,out2) ] } ^2; 

cost=cost2 +a3*cost3 +a4*cost4; %-cum4a-cum4b; 
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SUBSTITUTE ABSTRACT 

SYSTEM FOR DETERMINING PARAMETERS OF A TECHNICAL SYSTEM 

Parameters are established for a technical system, by means of which output signals can 
be determined from a set of superimposed, statistically mutoally independent input signals. 
The parameters are determined in such a manner that the statistical independence of the output 
signals is maximized. 
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follows: 

IN THE TITLE 

Change "METHOD AND ARRANGEMENT" to --SYSTEM-. 

IN THE SPECIFICATION 

Please REPLACE the pending specification with the SUBSTITUTE SPECIFICATION 
attached hereto. 



IN THE ABSTRACT 

Please REPLACE the originally filed Abstract with the enclosed Substitute Abstract. 



IN THE CLAIMS 

Please CANCEL claims 1-20 without prejudice or disclaimer of any of the subject 
matter claimed therein and ADD new claims in accordance with the following: 

21. A method for determining parameters of a technical system to determine output 
signals from a set of superimposed, statistically mutually independent input signals, in which 
the parameters, which are elements in an unmixing matrix, by which the set of superunposed 
input signals are multiplied, and by which the output signals are formed, are determined by 

5 optimization of a statistical independence of the output signals, said method comprising: 

repeatedly performing a time-delayed decorrelation calculation to determine 
intrinsic values in the unmixing matrix until cross-correlations are substantially minimized; and 

carrying out cumulant minimization, with the intrinsic values determined by a 
final time-delayed decorrelation calculation being used as start values for the cumulant 
10 minimization. 

22. The method as claimed in claim 21, in which the parameters are determined using 
an iterative method. 

23. The method as claimed in claim 21, in which the cumulant minimization is carried 
out by training a neural network. 

24. The method as claimed in claim 21, in which, during the optimization of the 
parameters of the urmiixing matrix, at least one diagonal parameter in the unmixing matrix is 
set to a predetermined value. 

25. The method as claimed in claim 21, in which the unmixing matrix is limited to a 
finite impulse response. 

26. The method as claimed in claim 21, in which the unmixing matrix is stabilized by 
projection on to a unit circle during the cumulant minimization process. 
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27. The method as claimed in claim 21, used for separation of superimposed, 
statistically mutually independent input signals. 

28. The method as claimed in claim 21, used for separation of superimposed, 
statistically mutoally independent, acoustic input signals. 

29. A system for determining parameters of a technical system to determine output 
signals from a set of superimposed, statistically mutually independent input signals, 
comprising: 

a processor to determine the parameters, which are elements in an unmixing 
matrix, by which the set of superimposed input signals are multiplied, and by which the output 
signals are formed, by optimization of statistical independence of the output signals, through 
repetition of a time-delayed decorrelation calculation to determine intrinsic values in the 
unmixing matrix until cross-correlations are substantially minimized, and cumulant 
minimization, with the intrinsic values used as start values for the cumulant minimization. 

30. The system as clakned in claun 29, in which the processor is set up in such a 
manner that the parameters are determined using an iterative method. 

31. The system as claimed in claun 29, further comprising a neural network to 
perform the cumulant minimization after training. 

32. The system as claimed in claim 9, in which the processor is set up in such a 
manner that, during the optimization of the parameters in the unmixing matrix, at least one 
diagonal parameter in the unmixing matrix is set to a predetermined value. 

33. The system as claimed in claim 29, in which the processor is set up in such a 
manner that the unmixing matrix is limited to a finite impulse response. 



34. The system as claimed in claim 29, in which the processor is set up in such a 
manner that the unmixing matrix is stabilized by projection on to a unit circle during the 
cumulant minimization process. 

35. The system as claimed in claim 29, used for separation of superimposed, 
statistically mutually independent input signals. 

36. The system as claimed in claim 29, used for separation of superimposed, 
statistically mutually independent, acoustic input signals. 

REMARKS 

This Preliminary Amendment is submitted to improve the form of the specification as 
originally-filed. It is respectfully requested that this Preliminary Amendment be entered in the 
above-referenced application. 

In accordance with the foregoing, claims 1-20 have been canceled and claims 21-36 
have been added. Thus, claims 21-36 are pending and are under consideration. 

A substitute specification is also being filed herewith. The substitute specification is 
accompanied by a marked-up copy of the original specification. No new matter has been 
added. 

If there are any questions regarding these matters, such questions can be addressed by 
telephone to the undersigned. Otherwise, an early action on the merits is respectfully solicited. 



If any further fees are required in connection with the filing of this Preliminary 
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MARKED UP SPECIFICATION ^^08 Rec'd FCT/PTC 2 7APR2O0f 
[Description] TITLE OF THE INVENTION 

[Method and arrangement] System for determining parameters of a technical system 

5 BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The invention relates to a method and [an arrangement] system for determining 
parameters of a technical system. 

10 DESCRIPTION OF THE RELATED ART 

During multichannel transmission and multichannel reception of signals, interference 
frequently occurs, for example, between the signals/images. One typical example in this case 
is mixing of a voice signal with noise, which can present a major problem in 
telecommunications and in video conferences. The present invention thus relates to the field of 

15 signal separation in order, for example, to recover an original voice signal. 

Typical known techniques for separation of source signals based on mixed signals are 
based on tune averaging or filtering of the signals. This intrinsically has disadvantages in terms 
of the computation complexity. 

Methods based on so-called blind channel equalization (signal equalization without 

20 prior knowledge of the transmission channel) are also known, but these methods always 

require a certain amount of knowledge about the source signals, such as knowledge about their 
statistical distribution. 

The problem of signal separation also occurs, for example, when two speakers are 
speaking into two microphones positioned at a distance from one another, so that each 

25 microphone receives a mixture of the signals spoken by the two speakers. The problem thus 
arises of separating the signal mixture once again, that is to say of separating a set of 
superimposed input signals. L. Molgedey, H.G. Schuster, "Separation of a Mixture of 
Independent Signals using Time-Delayed Correlations", Phys. Ref. Lett. 72, 3634 (1994) in 
this case discloses the following method: the problem of separating n superimposed and 

30 correlated source signals (input signals) and at the same tune of establishing mixing 



coefficients of the source intensities can be reduced to an intrinsic value problem, in which two 
symmetrical n x n matrices must be diagonalized simultaneously. The matrix elements are 
measurable time-delayed correlation functions. This intrinsic value problem can be solved by 
[means of] a neural network, in which case the learning rules for the lateral inhibiting 
5 interactions between the neurons can be established by [means of] a Liapunov function whose 
minima provide the (degenerate) solutions to the problem. 

This method has also already been applied to the acoustic input signals (see F. Ehlers, 
H.G. Schuster, "Blind Separation of convolutive mixtures and an application in automatic 
speech recognition", IEEE Trans. Signal Proc. (1997). 
10 DE 195 31388C1 discloses a signal separation method and a signal separation device 

for nonlinear mixtures of unknown signals (blind channel), which is illustrated schematically in 
Figure 3 . 

This German Patent relates to the separation of a signal mixture comprising the 
nonlinear superimposition of M unknown source signals XI, X2, where N (N > M) different 

15 mixmres of M source signals XI, X2 including any interference signal which may be present 
are supplied to a signal evaluation device, which analyzes the signal statistically to establish the 
nonlinear transmission factors and using these calculated factors to reverse the mixing process, 
so that the N outputs of the signal separation device contain, as approximately as possible, the 
M source signals without superimpositions. 

20 It thus becomes possible to treat nonlinear mixtures, in which [the] case the term 

nonlinear means that the source signals XI, X2 are mixed by [means of] an unknown nonlinear 
system G. The unknown system G is described by a so-called Volterra series, and the signal 
separation device G-1 establishes the coefficients in the Volterra series. Once this is known, it 
is possible to unmix the signal mixture. Furthermore, the coefficients can be used for further 

25 analysis in order to determine the position or speed of the signal sources. 

The method which is known from this document in this case essentially comprises two 

steps: 

Firstly, the nonlinear equations which are selected uniquely by the selectable degree of 
nonlinearity in the mixing process are solved by a sliding time window, and the solutions are 



averaged over this time. This time averaging process represents a major disadvantage of this 
known technique, since it increases the computation complexity, while at the same time 
increasing the time required for the calculation process. 

Secondly, the potential formed from a sufficiently large number of different cumulants 
5 of the estimated output signals is minimized, with the values required to calculate the potential 
originating from a sliding time window whose length can be varied. In this case, it is assumed 
that the mixing system varies sufficiently slowly that this change can be ignored in the 
calculation of the sought mixing factors. According to this German Patent, the second said step 
is carried out by constructing and minimizing a cost function. When the global minunum is 
10 reached, the optimum values, in this case the transmission factors, have been found. 

With regard to the time involved and the computation complexity, the method described 
in DE 195 31 388 CI is disadvantageous, since the tune averaging process has to be carried 
out at the end of the first method step mentioned above. 

15 SUMMARY OF THE INVENTION 

The present invention is thus based on the object of providing a method and [an 
arrangement] system which allow the separation of superimposed, statistically mutually 
independent, acoustic signals with reduced computation complexity. 

This object is achieved by [the method and by the arrangement having the features 

20 according to the independent clauns. In] a method for determining parameters of a technical 
system[,] by [means of which method] determining output signals [can be determined] from a 
set of superimposed, statistically mutually independent input signals^ The [, the] parameters 
are determined in such a manner that the statistical independence of the output signals is 
maxunized. 

25 [An arrangement] A system for determining parameters of a technical system, [by 

means of] in which [system] output signals can be determined from a set of superimposed, 
statistically mutually independent input signals, has a processor [which is set up in such a 
manner] that determines the parameters [can be determined] in such a manner that the 
statistical independence of the output signals is maximized. [Advantageous developments of 



the invention result from the dependent claims.] The parameters are preferably determined 
using an iterative method. 

In a further refinement, the parameters are elements in an unmixing matrix, by which 
the set of superimposed input signals is multiplied or else convoluted, by which [means] the 
5 output signals are formed. The optimization of the parameters m the unmixing matrix is 
preferably obtained by the following steps: 

- repetition of a tune-delayed decorrelation calculation in order to determine the 
intrinsic values in the unmixing matrix, 

- determination of the intrinsic values in the unmixing matrix for which cross- 
10 correlations assume a minimum value, and 

- carrying out cumulant minimization, with the intrinsic values determined in the 
previous step being used as start values for the cumulant minimization. 

The cumulant minimization can be used, for example, by training a neural network, or 
else by any other known minimization technique, such as gradient descent or Monte Carlo 
15 simulations. 

In one development, at least one diagonal parameter of the unmixing matrix is set to a 
predetermined value during the optimization of the parameters in the unmixing matrix, thus 
ensuring the stability of the mirumization process with respect to a global minimum. 

The unmixing matrix is preferably limited to a finite impulse response, that is to say an 
20 FIR filter (Finite Impulse Response) is used to form the individual components of the unmixing 
matrix. The FIR filter may be either a causal FIR filter or else a non-causal FIR filter. 

Furthermore, the unmixing matrix is preferably stabilized by projection on to a unit 
circle during the cumulant minimization process. 

The developments apply not only to the method but also to [the arrangement,] a system 
25 in which [case, in the case of the arrangement, the] a processor is [in each case] set up in such 
a manner that the [corresponding] method [step] can be [or is] carried out. 

The invention and its developments can advantageously be used for separation of 
superimposed, statistically mutually independent input signals, in particular acoustic input 
signals. 



The method and the [arrangement] system can be used for any desired number of input 

signals. 

[Further advantages, features and characteristics of the present invention will now be 
explained in more detail using an exemplary embodiment and with reference to the attached 
5 figures of] 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and advantages of the present invention will become more 
apparent and more readily appreciated from the following description of the preferred 
10 embodiments, taken in conjunction with the accompanying drawings, in which: 

Figure 1 shows the use of a system for separation of superimposed, statistically 
mutually independent acoustic signals according to the exemplary embodiment, 
Figure 2 shows a schematic illustration of the system from Figure 1, and 
Figure 3 shows a signal separation device, which is known from the prior art (DE 195 
15 31 388 CI), for nonlinear mixtures of unknown signals. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference will now be made in detail to the preferred embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings, wherein like 

20 reference numerals refer to like elements throughout. 

The statistical independence between the source signals (the original voice signal and 
the noise), also referred to as input signals in the following text, is used to recover the original 
voice signal from a mixture of signals, and the inverse process to that of the dynamic system, 
which has resulted in the mixing of the signals, is trained essentially approximately (is learnt). 

25 Two different mixtures of the voice signal and of the noise signal are obtained, for example, 
by [means of] two microphones 1, 2 (see Figure 1) which are at a distance from one another 
and/or are aligned in opposite directions. The so-called time-delayed decorrelation technique 
(TDD) is used to initiate the learning phase in the method, that is to say in order to determine 
and specify start values for the learning phase, which allows the computation complexity for 
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cumulant minimization as described in the following text to be reduced, and allows the risk of 
local minima to be reduced. 

Figure 1 shows two microphones 1,2, which pick up a first input signal Zl(t) and a 
second input signal Z2(t). These input signals Zl(t) and Z2(t) can in turn each be mixed with 

5 one another and with noise, as is represented symbolically by a mixing matrix S (see reference 
symbol 3) in Figure 1. After reception and/or transmission, a set Xl(t) and X2(t) of 
superimposed, statistically mumally independent input signals Zl(t) and Z2(t) is obtained. 
These signals are entered in a calculation unit 4, in which essentially two steps are carried out, 
as is represented symbolically by a calculation unit B (reference symbol 6) for the first step 

10 and a neural network 5 for the second step. 

The calculation unit 4 determines two output signals Yl(t) and Y2(t), respectively, 
which are approximately equal to the input signals Zl(t) and Z2(t), respectively, when the 
parameters are set optimally m the calculation unit 4. In other words, when the parameters of 
the matrices which are used are set optimally in the calculation unit 4, this calculation unit 4 

15 essentially carries out the inverse process to that of the dynamic mixing process, which is 
represented symbolically by the matrix S (reference symbol 3). The exemplary embodiment 
relates to the optimization process for setting the parameters for the unmixing matrix. 

The parameters of the matrices in the calculation unit 4 are in this case optimized such 
that the statistical independence between the output signals Yl(t), Y2(t) obtained by the matrix 

20 process in the calculation unit 4 is maximized. To this end, the output signals Yl(t) and Y2(t), 
respectively, are fed back to the calculation unit 4 (see the feedback loops 7 and 8, 
respectively). An iterative method is used to determine whether the statistical independence of 
the output signal Yl(t) and Y2(t), respectively, has increased in comparison to the previous 
iteration step (so that the iteration is in the "right" direction, in the direction of the global 

25 minimum of a cost function, which will be described in the following text)[, or not] . 

Figure 2 shows a mathematical representation of the layout from Figure 1, in which 
case the mixmg process 3 can be described mathematically by a matrix S(q), and the unmixing 
process, which is intended to be carried out by the calculation unit 4, is symbolized by an 
unmixing matrix M(q). 
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Figure 2 thus illustrates the problem of separation of a so-called multichannel blind 
source (multiple channel source without a-priori knowledge) into two dimensions. In this case, 
it is assumed that the mixing system S(q), where q represents a unit delay, is stable and, at the 
same time, also has a stable inversion, that is to say it is a minimal phase system. 

5 Furthermore, it is assumed that the input signals Zl(t) and Z2(t) (for example a voice signal 
and a noise signal) are statistically mutually independent and do not have a Gaussian 
distribution. The sets Xl(t) and X2(t) of superimposed input signals Zl(t) and Z2(t) are input 
signals to an unmixing system having an unmixing matrix M(q) whose parameters (matrix 
elements) are trained to maximize the statistical independence between the output signals Yl(t) 

10 and Y2(t). In this case, the term "training" means the well known learning process of, for 
example, a [neuron] neural network, which should be cited as an example of a technique to 
maximize the statistical independence. This is done by minimizing a cost function J(M), which 
will be described further below. 

A cumulant cost function is formed, which minunizes the diagonal cumulant elements 

15 of the cumulant order 2-4: 

Dcum«J(M)= X X h''^^^^^^^ 

i=lnondiag 

The following aspects of dynamic mixing by the mixing matrix S(q) need to be taken 
into account in this case: 

20 - Stability of the unmixing system: 

This is achieved by limiting M(q) to a finite impulse response (FIR filter). The stability 
of the FIR system M(q) can, furthermore, also be obtained by carrying out a projection on to a 
unit circle during the learning phase. Any non-causality of the inversion of S(q) which may be 
present can be compensated for by a suitable tune shift (delay) to the input signal X(t). 
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- Uniqueness of the separated signals Y(t): 

In the case of steady-state mixing processes, the original source signals are recovered 
by scaling. For dynamic unmixing, the risk of the separated signals Y(t) not being unique is 
even greater. It is obvious that, in the situation where Yl(t) and Y2(t) are statistically mutually 
5 independent, any linear-filtered modification of these signals will also still be statistically 
independent. Additional information is therefore required in order to reduce the inherent 
ambiguity of the problem. 

- Gaussian deformation of the data: 

10 Algorithms on a cumulant basis for steady-state blind source separation effectively 

minunize or eliminate higher-order diagonal cumulants corresponding to the output signals 
Y(t). On the other hand, linear filtering leads to the data being deformed to a Gaussian 
distribution, with the higher-order cumulants moving in the 0 direction. This can thus lead to 
limit solutions, in which the cost fimction reaches local minunum, but with the desired actual 

15 separation (global minimum) not being achieved. In order to avoid this undesirable situation, 
the structore of the unmixing transfer function (unmixing matrix) M(q) is subject to a number 
of limitations. 

In order to avoid the abovementioned problems, an approach is chosen in which at least 
one (or else all) of the diagonal elements is or are set to the unit value: 

20 Mll(q) = 1 andM22(q) = 1. 

This assumption is exact if the mixing elements Sll(q) and/or S22(q) likewise have a 
unit value "1". Otherwise, it is assumed that Sll(q) and/or S22(q) have stable inversions, 
which allows the diagonal elements to be scaled from M(q) to the unit value. This approach 
considerably reduces the ambiguity of a solution and, furthermore, effectively avoids the risk 

25 of excessive Gaussian-distribution deformation of the output signals. Even if, as stated above, 
the limitation to the diagonal elements of M(q) is at first glance to be highly restrictive, this 
assumption is generally satisfied in practical use. One typical example is the removal of noise 
from voice signals on the basis of a recording usmg two microphones, with the microphones 
being physically separated from one another or one microphone pointing in the direction of the 
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speaker, while the other microphone points in the opposite direction, so that the second signal, 
facing away from the speaker, essentially includes only a noise signal. 

The cumulant approach is based on the dhect determination of the diagonal cumulant, 
as is stated in the article mentioned initially by F. Ehlers and H. Schuster, "Blind Separation of 

5 convolutive mixtures and an application in automatic speech recognition" , IEEE Trans. Signal 
Proc. (1997), although this inherently has the disadvantage that numerical solution is highly 
complex. Suitable initialization is thus used for this minimization method. In order to 
determine start values for the minimization method, the present invention uses the technique of 
time-delay decorrelation (TDD) for simultaneous decorrelation of two different time delays, in 

10 which case this TDD technique can be based on a suitable matrix intrinsic-value problem. As 
already stated, this TDD technique is used according to the present invention for initiation of 
the diagonal (cross-correlation) cumulant minimization problem. 

In summary, the method can be subdivided into the two following steps: 

1 . Repetition of the TDD method on the basis of the intrinsic-value problem in the 
15 frequency domain for different delay pairs and determination of that solution for which the 

cross-correlation terms have a minimum value. 

2. Initiation (start) of the diagonal cumulant minimization process on the basis of the 
start values (FIR parameters) determined in the above step. 

A number of major characteristics and advantages will be summarized once again in the 
20 following text: 

- No a-priori knowledge of the signal characteristics is required, with the exception of 
the necessity for statistical independence. 

- The stability of the dynamic unmixing system is ensured by the modulation of its 
components as an FIR filter. 

25 - Excessive Gaussian distribution deformation is avoided by the approach of at least one 

of the elements in the mixing transfer function matrix (unmixing matrix) being set to the unit 
value, or being able to be scaled to the unit value, and 
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- since the cumulant minimization step (step 2) requires a large amount of computation 
complexity, the learning algorithm, for example of a neural network, is initialized using the 
TDD method. 

The following text contains a program in Matlab, e^ Version 4 [or Version] [lacuna], 
5 by [means of] which the exemplary embodiment described above can be implemented on a 
computer: 

function[ [ ] { cost, out l,out2 [ ] ] } =cumulant_costFIRa2(par,input,pl,pll,p2,p22,a3,a4); 
%[ [ ] X cost,outl,out2 [ ] ] } =cumulant_costFIRa2(par,input,pl,pll,p2,p22,a3,a4); 
10 % cumulant cost 

% FIR representation used 

% filter function used in both directions (non_causal) 

[[]{np,mp[]]i =size(par); 
15 firl=par(l:pl); 

firll=par(l+pl:pl+pll); 
fir2=par(l+pl+pll:pl+pll+p2); 
fir22 = par (p 1 + p 11 + p2 + 1 : mp) ; 

den=l; %FIRonly 

20 

outl = [ [ ] 1 input(:;l)-filter(firl,den,input(:,2))-flipud(filter([ [ ] X 0 ^11 [ ] ] i , [ [ 1 1 den [ 
]]},flipud(input(:,2))))[]]i; 

%/std(input(l,:)); %dlsim 

% filter 

25 out2=[ [ ] X input(:,2)-filter(fir2,den,input(:,l))-flipud(filter([ [ ] X 0 fir22 [ ] ] i , [ [ [ ] ] i X 
den], 

flipud(input{:,l)))) [] ] I ;%/std(input(:,2)); 

%dlsmi %filter 

out[ [ ] X outl out2 [ ] ] i ; 
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%outl =outl/std(outl); % this scaling was not needed in examples in SIP98 paper 
%out2 =out2/std(out2); 



Ld=0; % number of delays in calculating the cross-correlation 
5 costs =0; 
cost4=0; 

costALU = [[]{ []]}; 
costALL2=[[]X []]}; 
ol2 = outl.*out2; 
10 cost2=mean(ol2)^2; 

oll2=outl.*outl.*out2; 
ol22 = outl . *out2. *out2; 

15 ifaS = = 1 

cost3 = [ [ ] X mean(ol22) [ ] 1 K2 + [ [ ] { mean(ol22) [ ] ] K2; 

end 

ifa4 = = 1 

20 

cost4 = [ [ ] { mean(oll2.*outl)-3*mean(outl.^2)*mean(ol2) [ ] ] i ^2 + ... 
[ [ ] { mean((outl."2).*(out2."2))-2*mean(ol2)"2- 
mean(outl.^2)*mean(out2.^2) [ ] ] i ^ + ... 
[ [ ] Xmean(ol22.*out2)-3*mean(out2."2)*mean(ol2) [ ] ] } "2; 
25 end 

%cum4a=[ [ ] X cum4x(outl, outl, outl, outl) [ ] ] } ^2; 
%cum4b=[ [ ] X cum4x(out2,out2,out2,out2) [ ] ] i ^2; 
cost=cost2 +a3*cost3 +a4*cost4; %-cum4a-cum4b; 
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is known, it is possible to unmix the signal mixture. 
Furthermore, the coefficients can be used for further 
analysis in order to determine the position or speed of 
the signal sources. 
5 The method which is known from this document in 

this case essentially comprises two steps: 

• Firstly, the nonlinear equations which are selected 
uniquely by the selectable degree of nonlinearity in 
the mixing process are solved by a sliding time 

10 window, and the solutions are averaged over this 
time. This time averaging process represents a major 
disadvantage of this known technique, since it 
increases the computation complexity, while at the 
same time increasing the time required for the 

15 calculation process. 

• Secondly, the potential formed from a sufficiently 
large number of different cumulants of the estimated 
output signals is minimized, with the values required 
to calculate the potential originating from a sliding 

2 0 time window whose length can be varied. In this case, 

it is assumed that the mixing system varies 
sufficiently slowly that this change can be ignored 
in the calculation of the sought mixing factors. 
According to this German Patent, the second said step 
25 is carried out by constructing and minimizing a cost 

function. When the global minimum is reached, the 
optimum values, in this case the transmission 
factors, have been found. 

With regard to the time involved and the 
30 computation complexity, the method described in 
DE 195 31 388 CI is disadvantageous, since the time 
averaging process has to be carried out at the end of 
the first method step mentioned above. 

The present invention is thus based on the 

3 5 object of providing a method and an arrangement which 

allow the separation of superimposed, statistically 
mutually independent, acoustic signals with reduced 
computation complexity. 



GR 98 P 2958 



This object is achieved by the method and by 
the arrangement having the features according to the 
independent claims . 

In a method for determining parameters of a 
technical system, by means of which method output 
signals can be determined from a set of superimposed, 
statistically mutually independent input signals, the 
parameters are determined in such a manner that the 
statistical independence of the output signals is 
maximized. 

An arrangement for determining parameters of a 
technical system, by means of which system output 
signals can be determined from a set of superimposed, 
statistically mutually independent input signals, has a 
processor which is set up in such a manner that the 
parameters can be determined in such a manner that the 
statistical independence of the output signals is 
maximized . 

Advantageous developments of the invention 
result from the dependent claims. 

The parameters are preferably determined using 
an iterative method. 

In a further refinement, the parameters are 
elements in an unmixing matrix, by which the set of 
superimposed input signals is multiplied or else 
convoluted, by which means the output signals are 
formed . 

The optimization of the parameters in the 
unmixing matrix is preferably obtained by the following 
steps : 

- repetition of a time-delayed decorrelation 
calculation in order to determine the intrinsic values 
in the unmixing matrix, 
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- determination of the intrinsic values in the unmixing 
matrix for which cross-correlations assume a minimum 
value, and 

- carrying out cumulant minimization, with the 
intrinsic values determined in the previous step being 
used as start values for the cumulant minimization. 

The cumulant minimization can be used, for 
example, by training a neural network, or else by any 
other known minimization technique, such as gradient 
descent or Monte Carlo simulations. 

In one development, at least one diagonal 
parameter of the unmixing matrix is set to a 
predetermined value during the optimization of the 
parameters in the unmixing matrix, thus ensuring the 
stability of the minimization process with respect to a 
global minimum. 

The unmixing matrix is preferably limited to a 
finite impulse response, that is to say an FIR filter 
(Finite Impulse Response) is used to form the 
individual components of the unmixing matrix. The FIR 
filter may be either a causal FIR filter or else a non- 
causal FIR filter. 

Furthermore, the unmixing matrix is preferably 
stabilized by projection on to a unit circle during the 
cumulant minimization process. 

The developments apply not only to the method 
but also to the arrangement, in which case, in the case 
of the arrangement, the processor is in each case set 
up in such a manner that the corresponding method step 
can be or is carried out. 

The invention and its developments can 
advantageously be used for separation of superimposed, 
statistically mutually independent input signals, in 
particular acoustic input signals. 
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The method and the arrangement can be used for 
any desired number of input signals. 

Further advantages, features and 

characteristics of the present invention will now be 
5 explained in more detail using an exemplary embodiment 
and with reference to the attached figures of the 
drawings, in which: 

Figure 1 shows the use of a system for separation 
of superimposed, statistically mutually 

10 independent acoustic signals according to the 

exemplary embodiment, 

Figure 2 shows a schematic illustration of the 
system from Figure 1, and 

Figure 3 shows a signal separation device, which 

15 is known from the prior art (DE 195 31 388 CI) , 

for nonlinear mixtures of unknown signals. 

The statistical independence between the source 
signals (the original voice signal and the noise) , also 
referred to as input signals in the following text, is 

20 used to recover the original voice signal from a 
mixture of signals, and the inverse process to that of 
the dynamic system, which has resulted in the mixing of 
the signals, is trained essentially approximately (is 
learnt) . Two different mixtures of the voice signal and 

25 of the noise signal are obtained, for example, by means 
of two microphones 1, 2 (see Figure 1) which are at a 
distance from one another and/or are aligned in 
opposite directions. The so-called time-delayed 
decorrelation technique (TDD) is used to initiate the 

3 0 learning phase in the method, that is to say in order 
to determine and specify start values for the learning 
phase, which allows the computation complexity for 
cumulant minimization as described in the following 
text to be reduced, and allows the risk of local minima 

3 5 to be reduced. 
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Figure 1 shows two microphones 1, 2, which pick 
up a first input signal Zl(t) and a second input signal 
Z2(t). These input signals Zl(t) and Z2 (t) can in turn 
each be mixed with one another and with noise, as is 
represented symbolically by a mixing matrix S (see 
reference symbol 3) in Figure 1. After reception and/or 
transmission, a set Xl(t) and X2 (t) of superimposed, 
statistically mutually independent input signals Zl (t) 
and Z2 (t) is obtained. These signals are entered in a 
calculation unit 4, in which essentially two steps are 
carried out, as is represented symbolically by a 
calculation unit B (reference symbol 6) for the first 
step and a neural network 5 for the second step. 

The calculation unit 4 determines two output 
signals Yl (t) and Y2 (t) , respectively, which are 
approximately equal to the input signals Zl (t) and 
Z2 (t) , respectively, when the parameters are set 
optimally in the calculation unit 4. In other words, 
when the parameters of the matrices which are used are 
set optimally in the calculation unit 4, this 
calculation unit 4 essentially carries out the inverse 
process to that of the dynamic mixing process, which is 
represented symbolically by the matrix S (reference 
symbol 3) . The exemplary embodiment relates to the 
optimization process for setting the parameters for the 
unmixing matrix. 

The parameters of the matrices in the 
calculation unit 4 are in this case optimized such that 
the statistical independence between the output signals 
Yl(t), Y2 (t) obtained by the matrix process in the 
calculation unit 4 is maximized. To this end, the 
output signals Yl(t) and Y2 (t) , respectively, are fed 
back to the calculation unit 4 (see the feedback loops 
7 and 8, respectively) . An iterative method is used to 
determine whether the statistical independence of the 
output signal Yl (t) and Y2 (t) , 
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respectively, has increased in comparison to the 
previous iteration step (so that the iteration is in 
the "right" direction, in the direction of the global 
minimum of a cost function, which will be described in 
the following text), or not. 
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Figure 2 shows a mathematical representation of 
the layout from Figure 1, in which case the mixing 
process 3 can be described mathematically by a matrix 
S{q), and the unmixing process, which is intended to be 
carried out by the calculation unit 4, is symbolized by 
an unmixing matrix M(q) . 

Figure 2 thus illustrates the problem of 
separation of a so-called multichannel blind source 
(multiple channel source without a-priori knowledge) 
into two dimensions. In this case, it is assumed that 
the mixing system S (q) , where q represents a unit 
delay, is stable and, at the same time, also has a 
stable inversion, that is to say it is a minimal phase 
system. Furthermore, it is assumed that the input 
signals Zl(t) and Z2 (t) (for example a voice signal and 
a noise signal) are statistically mutually independent 
and do not have a Gaussian distribution. The sets Xl(t) 
and X2(t) of superimposed input signals Zl(t) and Z2 (t) 
are input signals to an unmixing system having an 
unmixing matrix M(q) whose parameters (matrix elements) 
are trained to maximize the statistical independence 
between the output signals Yl(t) and Y2 (t) . In this 
case, the term "training" means the well known learning 
process of, for example, a neuron network, which should 
be cited as an example of a technique to maximize the 
statistical independence. This is done by minimizing a 
cost function J (M) , which will be described further 
below . 

A cumulant cost function is formed, which 
minimizes the diagonal cumulant elements of the 
cumulant order 2-4: 

Dcum « J(M) = X! S [c*''nondiagf 

i=lnond.iag 

The following aspects of dynamic mixing by the 
mixing matrix S (q) need to be taken into account in 
this case: 
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Stability of the unmixing system: 

This is achieved by limiting M(q) to a finite impulse 
response (FIR filter) . The stability of the FIR 
system M(q) can, furthermore, also be obtained by 
carrying out a projection on to a unit circle during 
the learning phase. Any non-causality of the 
inversion of S (q) which may be present can be 
compensated for by a suitable time shift (delay) to 
the input signal X(t) . 

Uniqueness of the separated signals Y(t) : 
In the case of steady-state mixing processes, the 
original source signals are recovered by scaling. For 
dynamic unmixing, the risk of the separated signals 
Y(t) not being unique is even greater. It is obvious 
that, in the situation where Yl(t) and Y2 (t) are 
statistically mutually independent, any linear- 
filtered modification of these signals will also 
still be statistically independent. Additional 
information is therefore required in order to reduce 
the inherent ambiguity of the problem. 

Gaussian deformation of the data: 

Algorithms on a cumulant basis for steady- state blind 
source separation effectively minimize or eliminate 
higher-order diagonal cumulants corresponding to the 
output signals Y(t). On the other hand, linear 
filtering leads to the data being deformed to a 
Gaussian distribution, with the higher-order 
cumulants moving in the 0 direction. This can thus 
lead to limit solutions, in which the cost function 
reaches local minimum, but with the desired actual 
separation (global minimum) not being achieved. In 
order to avoid this undesirable situation, the 
structure of the unmixing transfer function (unmixing 
matrix) M(q) is subject to a number of limitations. 
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In order to avoid the abovement ioned problems, 
an approach is chosen in which at least one (or else 
all) of the diagonal elements is or are set to the unit 
value : 
5 Mil (q) = 1 
and 

M22 (q) = 1 . 

This assumption is exact if the mixing elements 
Sll (q) and/or S22 (q) likewise have a unit value "1" . 

10 Otherwise, it is assumed that Sll(q) and/or S22 (q) have 
stable inversions, which allows the diagonal elements 
to be scaled from M(q) to the unit value. This approach 
considerably reduces the ambiguity of a solution and, 
furthermore, effectively avoids the risk of excessive 

15 Gaussian-distribution deformation of the output 
signals. Even if, as stated above, the limitation to 
the diagonal elements of M(q) is at first glance to be 
highly restrictive, this assumption is generally 
satisfied in practical use. One typical example is the 

20 removal of noise from voice signals on the basis of a 
recording using two microphones, with the microphones 
being physically separated from one another or one 
microphone pointing in the direction of the speaker, 
while the other microphone points in the opposite 

25 direction, so that the second signal, facing away from 
the speaker, essentially includes only a noise signal. 

The cumulant approach is based on the direct 
determination of the diagonal cumulant, as is stated in 
the article mentioned initially by F. Ehlers and 

3 0 H. Schuster, "Blind Separation of convolutive mixtures 
and an application in automatic speech recognition", 
IEEE Trans. Signal Proc . (1997), although this 
inherently has the disadvantage that numerical solution 
is highly complex. Suitable initialization is thus used 

35 for this minimization method. In order to determine 
start values 
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for the minimization method, the present invention uses 
the technique of time-delay decorrelation (TDD) for 
simultaneous decorrelation of two different time 
delays, in which case this TDD technique can be based 
5 on a suitable matrix intrinsic-value problem. As 
already stated, this TDD technique is used according to 
the present invention for initiation of the diagonal 
(cross-correlation) cumulant minimization problem. 

In summary, the method can be subdivided into 
10 the two following steps: 

1. Repetition of the TDD method on the basis of the 
intrinsic-value problem in the frequency domain 
for different delay pairs and determination of 

15 that solution for which the cross-correlation 

terms have a minimum value . 

2. Initiation (start) of the diagonal cumulant 
minimization process on the basis of the start 

2 0 values (FIR parameters) determined in the above 

step . 



A number of major characteristics and 
advantages will be summarized once again in the 
following text: 



No a-priori knowledge of the signal 
characteristics is required, with the exception of 
the necessity for statistical independence. 
3 0 - The stability of the dynamic unmixing system is 
ensured by the modulation of its components as an 
FIR filter. 

Excessive Gaussian distribution deformation is 
avoided by the approach of at least one of the 
35 elements in the mixing transfer function matrix 

(unmixing matrix) being set to the unit value, or 
being able to be scaled to the unit value, and 
since the cumulant minimization step (step 2) 
requires a large amount of computation complexity. 
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the learning algorithm, for example of a neural 
network, is initialized using the TDD method. 
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The following text contains a program in 
Matlab, Version 4 or Version [lacuna] , by means of 
which the exemplary embodiment described above can be 
implemented on a computer: 

5 

function [cost, outl,out2] =cumulajit_costFIRa2 (par, input, pi, pll,p2,p 
22,a3,a4) ; 

% [cost , out 1 , out2] =cumulant_costFIRa2 (par, input , pi , pll ,p2 , p22 , a3 , a 
4); 

10 % cumulant cost 

% FIR representation used 

% filter function used in both directions (non_causal) 



[np,np] =size (par) ; 
15 firl=par(l:pl) ; 

firll=par (l+pl:pl+pll) ; 
fir2=par (l+pl+pll:pl+pll+p2) ; 
fir22=par (pl+pll+p2+l:iTp) ; 

den=l; %FIR only 

20 

outl= [input ( : ;1) -f liter (firl, den, input (:, 2) ) -flipud (filter ( [0 
f irll] , [den] , flipud (input ( : , 2 ) ) ) ) ] ; 

%/std(input (1, : ) ) ; %dlsim 



2 5 %f liter 

out2= [input ( : , 2 ) - filter (fir2 , den, input ( : , 1) ) -flipud (filter ( [0 
fir22] , [den] , 

flipuddnput ( : , 1) ) ) ) ] ;%/std(input ( : ,2) ) ; 

%dlsim %filter 

30 

out [outl out2] ; 

%outl=outl/std(outl) ; % this scaling was not needed in exarrples 
in SIP98 paper 
%out2=out2/std(out2) ; 

35 

Ld=0; % number of delays in calculating the cross-correlation 
costs =0; 
cost4=0; 
costALLl= [] ; 
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costALL2= [] ; 
0l2=0Utl . *OUt2 ; 
cost2=mean (ol2) ^2 ; 

5 oll2=outl . *outl . *out2 ; 
ol22=outl . *out2 . *out2 ; 

if a3 ==1 

cost3= [mean (ol22) ] ^2+ [mean (ol22) ] ^2 ; 

10 

end 

if a4 ==1 

15 cost4= [mean (oll2 . *outl) - 

3*mean (outl . ^2) *mean (ol2) ] ^2+ . . . 

[mean ( (outl . ^2) . * (out2 . ^2) ) -2*mean (ol2) ^2- 
mean (outl . ^2) *mean (out2 . ^2) ] ^+ . . . 

[mean (ol22 . *out2) -3*mean (out2 . ^2) *mean (ol2) ] ^2 ; 

20 

end 

%cum4a= [cum4x (outl , out 1 , out 1 , outl ) ] ^2 ; 
%cum4b= [cum4x (out2 , out2 , out2 , out2 )]^2 ; 

25 



cost=cost2+a3*cost3+a4*cost4 ; 



%-cum4a-cum4b 
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Patent Claims 

1 . A method for determining parameters of a 
technical system, by means of which output signals can 
be determined from a set of superimposed, statistically 

5 mutually independent input signals, in which the 
parameters, which are elements in an unmixing matrix, 
by which the set of superimposed input signals are 
multiplied, and by which means the output signals are 
formed, are determined by optimization of a statistical 
10 independence of the output signals, using the following 
steps : 

- repetition of a time-delayed decorrelat ion 
calculation (6) in order to determine the intrinsic 
values in the unmixing matrix, 

15 - determination of the intrinsic values in the unmixing 
matrix for which cross-correlations assume a minimum 
value, and 

- carrying out cumulant minimization (5) , with the 
intrinsic values determined in the previous step being 

20 used as start values for the cumulant minimization. 

2. The method as claimed in claim 1, in which the 
parameters are determined using an iterative method. 

3. The method as claimed in claim 1 or 2 , in which 
the cumulant minimization is carried out by training a 

2 5 neural network (5) . 

4. The method as claimed in one of claims 1 to 3, 
in which, during the optimization of the parameters of 
the unmixing matrix, at least one diagonal parameter in 
the unmixing matrix is set to a predetermined value. 

3 0 5. The method as claimed in one of claims 1 to 4, 

in which the unmixing matrix is limited to a finite 
impulse response. 

6. The method as claimed in one of claims 1 to 5 , 

in which the unmixing matrix is stabilized by 
3 5 projection on to a unit circle during the cumulant 
minimization process (5) . 
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7. The method as claimed in one of claims 1 to 6 , 
used for separation of superimposed, statistically 
mutually independent input signals. 

8. The method as claimed in one of claims 1 to 6, 
5 used for separation of superimposed, statistically 

mutually independent, acoustic input signals. 

9. An arrangement for determining parameters of a 
technical system, by means of which output signals can 
be determined from a set of superimposed, statistically 

10 mutually independent input signals, having a processor 
which is set in such a manner that the parameters, 
which are elements in an unmixing matrix, by which the 
set of superimposed input signals are multiplied, and 
by which means the output signals are formed, are 

15 determined by optimization of a statistical 
independence of the output signals, using the following 
steps : 

- repetition of a time-delayed decorrelat ion 
calculation (6) in order to determine the intrinsic 

2 0 values in the unmixing matrix, 

- determination of the intrinsic values in the unmixing 
matrix for which cross-correlations assume a minimum 
value, and 

- carrying out cumulant minimization (5) , with the 
25 intrinsic values determined in the previous step being 

used as start values for the cumulant minimization. 

10. The arrangement as claimed in claim 9, in which 
the processor is set up in such a manner that the 
parameters are determined using an iterative method. 

3 0 11. The arrangement as claimed in claim 9 or 10, 

in which the processor is set up in such a manner that 
the cumulant minimization is carried out by training a 
neural network (5) . 

12 . The arrangement as claimed in one of claims 9 

35 to 11, 

in which the processor is set up in such a manner that, 
during the optimization of the parameters in the 
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unmixing matrix, at least one diagonal parameter in the 
unmixing matrix is set to a predetermined value. 
13 . The arrangement as claimed in one of claims 9 

to 12, 

5 in which the processor is set up in such a manner that 
the unmixing matrix is limited to a finite impulse 
response . 

14 . The arrangement as claimed in one of claims 9 

to 13, in which the processor is set up in such a 
10 manner that the unmixing matrix is stabilized by 
projection on to a unit circle during the cumulant 
minimization process (5) . 

15. The arrangement as claimed in one of claims 9 
to 14, used for separation of superimposed, 

15 statistically mutually independent input signals. 

16. The arrangement as claimed in one of claims 9 
to 14, used for separation of superimposed, 
statistically mutually independent, acoustic input 
signals . 
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Abstract 

Method and arrangement for determining parameters of a 
technical system 

Parameters are established for a technical 
system, by means of which output signals can be 
determined from a set of superimposed, statistically 
mutually independent input signals. The parameters are 
determined in such a manner that the statistical 
independence of the output signals is maximized. 
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Beschreibung 

Verfahren und Anordziung zur Ermittlung von Parametern eines 
-bechnischen Sys-tems 

Die Erfindung betrifft ein Verfahren sowie einer Anordnung zur 
Ermittlung von Parametern eines technischen Systems 

Bei einer Vielkanal-Ubertragung und einem Vielkanal-Empf ang von 
Signalen tritt haufig eine Interferenz beispielsweise zwischen 
den Signalen/Bildern auf. Ein typisches Beispiel ist dabei eine 
Mischung eines Sprachsignals mit Rauschen, was bei der 
Telekommunikation und bei Videokonf erenzen ein groiies Problem 
darstellen kann. Die vorliegende Erfindung betrifft daher das 
Gebiet der Signaltrennung, urn beispielsweise ein urspriingliches 
Sprachsignal wiederzugewinnen . 

Typische bekannte Techniken zur Trennung der Quellensignale 
ausgehend von Mischsignalen basieren auf einer zeitlichen 
Mittelung oder einer Filterung der Signale. Dies hat indessen 
Nachteile beziiglich des Rechenauf wands zur Folge. 

Es sind auch Verfahren auf der Grundlage der sogenannten Blind 
Channel Equalization ( Signalent zerrung ohne Vorkenntnisse tiber 
den Ubertragungskanal) bekannt, aber diese Verfahren benotigen 
immer eine gewisse Kenntnis iiber die Quellsignale, wie 
beispielsweise eine Kenntnis iiber ihre statistische Verteilung. 

Das Problem der Signaltrennung tritt beispielsweise auch auf, 
wenn zwei Sprecher in zwei entfernt von ihnen stehende 
Mikrofone sprechen, so daR jedes Mikrofon ein Gemisch der von 
den zwei Sprechern gesprochenen Signale aufniramt. Somit besteht 
das Problem, das Signalgemisch, also eine Menge iiberlagerter 
Eingangssignale wieder zu trennen. Aus L.Molgedey, H.G. 
Schuster, „Separation of a Mixture of Independent Signals using 
Time-Delayed Correlations", Phys . Ref. Lett, 72, 3634 (1994) 
ist dabei das folgende Verfahren bekannt: Das Problem, n 
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uberlagerte und korrelierte Quellensignale (Eingangssignale) zu 
trennen und gleichzeitige die Mischungskoef f izienten der 
Quellenstarken zu bestirmnen, lafit sich auf ein Eigenwertproblem 
reduzieren, bei dem simultan zwei symmetrische n x n Matrizen 
diagonalisiert werden mussen. Die Matrixelemente sind mefibare 
zeitverzogerte Korrelationsfunktionen. Die Losung des 
Eigenwertproblems kann durch ein neuronales Netz erfolgen, 
wobei die Lernregel fur die lateralen inhibitorischen 
Wechselwirkungen zwischen den Neuronen durch eine Liapunov- 
Funktion bestimmt werden kann, deren Minima die (entarteten) 
Losungen des Problems liefern. 

Dieses Verfahren wurde auch bereits auf akustische 
Eingangssignale angewandt (siehe F. Ehlers, H. G. Schuster, 
„Blind Separation of convolutive mixtures and an application in 
automatic speech recognition'' IEEE Trans. Signal Proc. (1997). 

Aus der DE 195 31 388 CI ist ein Signaltrennungsverf ahren und 
eine Signaltrennungseinrichtung fiir nichtlineare Mischungen 
unbekannter Signale (Blind Channel) bekannt, das schematisch in 
Fig. 3 dargestellt ist. 

Dieses deutsche Patent behandelt die Separierung eines 
Signalgemisches, bestehend aus der nichtlinearen Uberlagerung 
von M unbekannten Quellsignalen XI, X2, wobei N (N > M) 
unterschiedliche Mischungen der M Quellsignale XI, X2 inklusive 
eines eventuellen Storsignals einer Signalauswerteeinrichtung 
zugefiihrt werden, die durch eine statistische Analyse der 
Signale die nichtlinearen Ubertragungsf aktoren bestimmt und mit 
diesen errechneten Faktoren die Mischung riickgangig macht, so 
daft die N Ausgange der Signaltrennungseinrichtung moglichst 
naherungsweise die M Quellsignale ohne Uberlagerungen 
enthalten. Dadurch wird eine Behandlung nichtlinearer Gemische 
moglich, wobei nichtlinear bedeutet, dafi die Quellsignale XI, 
X2 durch ein unbekanntes nichtlineares System G gemischt 
werden. Das unbekannte System G wird durch eine sogenannte 
Volterra-Reihe beschrieben, und die Signaltrennungseinrichtung 
G-1 bestimmt die Koeff izienten der Volterra-Reihe. Mit deren 
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Kenntnis ist eine Entmischung des Signalgeinischs moglich. 
Aulierdem konnen die Koef f izienten zu weiteren Analysen zur 
Orts- Oder Geschwindigkeitsbestiininung der Signalquellen benutzt 
werden. 

Das aus dieser Druckschrift bekannte Verfahren besteht dabei im 
wesentlichen aus zwei Schritten: 

• Erstens werden die durch den wahlbaren Grad der 
Nichtlinearitat bei der Mischung eindeutig bestimmten 
nichtlinearen Gleichungen fiir ein gleitendes Zeitfenster 
gelost und die Losungen werden tiber die Zeit gemittelt. Diese 
zeitliche Mittelung stellt einen Hauptnachteil dieser 
bekannten Technik dar, da sie den Rechenaufwand und 
gleichzeitig die Zeitdauer fur die Berechnung erhoht. 

• Zweitens wird aus einer geniigend grolien Anzahl von 
unterschiedlichen Kumulanten der geschatzten Ausgangssignale 
gebildetes Potential minimiert, wobei die zur Berechnung des 
Potentials notigen Werte aus einem gleitenden Zeitfenster 
einer wahlbaren Lange stammen. Dabei ist vorausgesetzt , dali 
sich das Mischungssystem so langsam andert, dali diese 
Anderung bei der Berechnung der gesuchten Mischungsf aktoren 
vernachlassigt werden kann. GemaB diesem deutschen Patent 
wird zur Ausfuhrung des zweiten genannten Schrittes eine 
Kostenf unktion konstruiert, die minimiert wird. Wenn das 
globale Minimum erreicht ist, hat man die optimalen Werte, in 
diesem Fall der Ubertragungsf aktoren, gefunden. 

Hinsichtlich des zeitlichen Aufwands sowie des Rechenaufwands 
ist das in der DE 195 31 388 CI beschriebene Verfahren aufgrund 
der Ausfuhrung einer zeitlichen Mittelung am AbschluJb des 
ersten, oben genannten Verf ahrensschrittes nachteilig. 

Die vorliegende Erfindung hat daher zur Aufgabe, ein Verfahren 
und eine Anordnung bereitzustellen, die die Trennung 
tiberlagerter, statistisch voneinander unabhangiger akustischer 
Signale mit verringertem Rechenaufwand ermoglicht. 
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Diese Aufgabe wird durch das Verfahren sowie durch die 
Anordnung mit den Merkmalen gemali den unabhangigen Anspruchen 
gelost . 

Bei einem Verfahren zur Ermittlung von Parametern eines 
technischen Systems, mit dem Ausgangssignale aus einer Menge 
uberlagerter, statistisch voneinander unabhangiger 
Eingangssignale ermittelt werden konnen, werden die Parameter 
derart ermittelt, daii die statist ische Unabhangigkeit der 
Ausgangssignale maximiert wird. 

Eine Anordnung zur Ermittlung von Parametern eines technischen 
Systems, mit dem Ausgangssignale aus einer Menge iiberlagerter , 
statistisch voneinander unabhangiger Eingangssignale ermittelt 
werden konnen, weist einen Prozessor auf, der derart 
eingerichtet ist, dali die Parameter derart ermittelt werden 
konnen, dad die statistische Unabhangigkeit der Ausgangssignale 
maximiert wird, 

Vorteilhafte Weiterbildungen der Erfindung ergeben sich aus den 
abhangigen Anspruchen. 

Die Parameter werden bevorzugt in einem iterativen Verfahren 
ermittelt . 

In einer weiteren Ausgestaltung sind die Parameter Elemente 
einer Entmischmatrix, mit der die Menge der iiberlagerten 
Eingangssignale multipliziert oder auch gefaltet wird, wodurch 
die Ausgangssignale gebildet werden. 

Die Optimierung der Parameter der Entmischmatrix wird bevorzugt 
durch die folgenden Schritte erhalten: 

- Wiederholung einer zeitverzogerten Dekorrelationsberechnung 
zur Ermittlung der Eigenwerte der Entmischmatrix, 



GR 98 P 2958 



5 

- Ermittlung der Eigenwerte der Entmischmatrix, fiir die 
Kreuzkorrelationen einen minimalen Wert annehmen, und 

- Ausfiihrung einer Kumulantenminimierung, wobei als Startwerte 
fiir die Kumulantenminimierung die im vorherigen Schritt 
ermittelten Eigenwerte verwendet werden. 

Die Kumulantenminimierung kann beispielsweise durch Trainieren 
eines neuronalen Netzes, aber auch jegliche andere bekannte 
Minimierungstechnik, wie beispielsweise Gradientenabstieg oder 
Monte-Carlo-Simulationen verwendet werden. 

In einer Weiterbildung wird bei der Optimierung der Parameter 
der Entmischmatrix wenigstens ein Diagonalparameter der 
Entmischmatrix auf einen vorgegebenen Wert gesetzt, womit , urn 
eine Stabilitat des Minimierungsvorgangs hin zu einem globalen 
Minimum zu gewahrleisten . 

Die Entmischmatrix wird bevorzugt auf eine finite Impulsantwort 
begrenzt, d.h. es wird ein FIR-Filter (Finite I^mpulse Response) 
eingesetzt zur Bildung der einzelnen Komponenten der 
Entmischmatrix. Der FIR-Filter kann sowohl ein kausales FIR- 
Filter Oder auch ein nicht-kausales FIR-Filter sein. 

Ferner wird die Entmischmatrix wahrend der 

Kumulantenminimierung bevorzugt durch Projektion in einen 
Einheitskreis stabilisiert . 

Die Weiterbildungen gelten sowohl fiir das Verfahren als auch 
fiir die Anordnung, wobei bei der Anordnung jeweils der 
Prozessor derart eingerichtet ist, daft der entsprechende 
Verf ahrensschritt durchf tihrbar ist oder durchgef tihrt wird. 

Die Erfindung sowie deren Weiterbildungen konnen vorteilhaft 
eingesetzt werden zur Trennung iiberlagerter , statistisch 
voneinander unabhangiger Eingangssignale, insbesondere 
akustischer Eingangssignale. 
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Das Verfahren sowie die Anordnung sind fur eine beliebige 
Anzahl von Eingangssignalen anwendbar. 

Weitere Vorteile, Merkmale und Eigenschaf ten der vorliegenden 
Erfindung werden nunmehr bezugnehmend auf die beiliegenden 
Figuren der Zeichnungen anhand eines Ausf iihrungsbeispiels naher 
erlautert . 

Fig. 1 zeigt die Anwendung eines Systems zur Trennung 
iiberlagerter, statistisch voneinander unabhangiger 
akustischer Signale gemaB dem Ausf iihrungsbeispiel. 

Fig. 2 zeigt eine symbolische Darstellung des Systems von 
Fig. 1, und 

Fig. 3 zeigt eine aus dem Stand der Technik (DE 195 31 388 
CI) bekannte Signaltrennungseinrichtung fur nichtlineare 
Mischungen unbekannter Signale. 

Zur Wiedergewinnung des ursprunglichen Sprachsignals wird aus 
einer Mischung von Signalen die statistische Unabhangigkeit 
zwischen den Quellensignalen {ursprungliches Sprachsignal und 
Rauschen) , im weiteren auch als Eingangssignale bezeichnet, 
ausgenutzt und der inverse Vorgang des dynamischen Systems, der 
die Mischung der Signale ergeben hat, wird im wesentlichen 
naherungsweise trainiert (gelernt) . Zwei verschiedene 
Mischungen des Sprachsignals bzw. des Rauschsignals werden 
beispielsweise durch zwei Mikrofone 1, 2 (vgl. Fig.l) erhalten, 
die voneinander beabstandet sind und/oder in entgegengesetzten 
Richtungen ausgerichtet sind. Bei dem Verfahren wird die 
sogenannte zeitverzogerte Dekorrelationstechnik (TDD, time 
delayed decorrelation) verwendet, urn die Lernphase zu 
initiieren, d.h. um Startwerte fur die Lernphase zu ermitteln 
und vorzugeben, wodurch der Berechnungsauf wand fiir eine im 
weiteren beschriebenen Kumul ant enminimie rung verringert werden 
kann und die Gefahr lokaler Minima verringert werden kann. 
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Fig.l zeigt zwei Mikrofone 1, 2, die ein erstes Eingangssignal 
Zl(t) und ein zweites Eingangssignal Z2(t) aufnehmen. Diese 
Eingangssignale Zl(t) und Z2(t) konnen untereinander wiederum 
jeweils mit Rauschen vermischt sein, was durch eine Mischmatrix 
S (siehe Bezugszeichen 3) symbolisch in Fig.l dargestellt ist. 
Nach dem Empfang bzw. der Ubertragung wird eine Menge XI (t) und 
X2(t) iiberlagerter, statistisch voneinander unabhangiger 
Eingangssignale Zl (t) und Z2 (t) erhalten. Diese Signale werden 
in eine Berechnungseinheit 4 eingegeben, in der im wesentlichen 
zwei Schritte ausgefiihrt werden, die symbolisch durch eine 
Berechnungseinheit B (Bezugszeichen 6) fur den ersten Schritt 
sowie ein neuronales Netzwerk 5 fur den zweiten Schritt 
dargestellt ist. 

Durch die Berechnungseinheit 4 werden zwei Ausgangssignale 
Yl(t) bzw. Y2(t) ermittelt, die bei optimaler Einstelllung der 
Parameter in der Berechnungseinheit 4 naherungsweise gleich den 
Eingangssignalen Zl(t) bzw. Z2(t) sind. Mit anderen Worten, bei 
optimaler Einstellung der Parameter der verwendeten Matrizen in 
der Berechnungseinheit 4 erfolgt durch diese Berechnungseinheit 
4 im wesentlichen der inverse Vorgang zu dem dynamischen 
Mischvorgang, der durch die Matrix S (Bezugszeichen 3) 
symbolisch dargestellt ist. Das Ausf uhrungsbeispiel beschaftigt 
sich mit dem Optimierungsvorgang der Einstellung der Parameter 
der Entmischmatrix. 

Es werden die Parameter der Matrizen in der Berechnungseinheit 
4 derart optimiert, daii die statistische Unabhangigkeit 
zwischen den durch den Matrizenvorgang in der 
Berechnungseinheit 4 gewonnenen Ausgangssignale yi(t), Y2 (t) 
maximiert wird. Zu diesem Zweck werden die Ausgangssignale 
Yl(t) bzw. Y2(t) zu der Berechnungseinheit 4 zuriickgef iihrt (s. 
Riickf iihrschleif en 7 bzw. 8) . Durch ein iteratives Verfahren 
wird ermittelt, ob sich die statistische Unabhangigkeit der 
Ausgangssignale Yl(t) bzw. Y2(t) im Vergleich zu dem vorherigen 
Schritt der Iteration erhdht hat (und somit die Iteration die 
„richtige" Richtung in Richtung des globalen Minimums einer im 
weiteren beschriebenen Kostenf unktion einnimmt) oder nicht. 
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Fig. 2 zeigt eine mathematische Darstellung des Schemas von 
Fig.l, wobei der Mischvorgang 3 durch eine Matrix S(q) 
mathematisch beschrieben werden kann und der Entmischvorgang, 
der durch die Berechnungseinheit 4 erfolgen soli, durch eine 
Entmischmatrix M(q) symbolisiert wird. 

In Fig. 2 ist somit das Problem der Trennung einer sogenannten 
Multi-Channel Blind Source (Vielf ach-Kanal-Quelle ohne a- 
priori-Kenntnis) in zwei Dimensionen dargestellt. Dabei ist 
angenoiranen, dafi das Mischsystem S(q), wobei q fiir eine 
Einheitsverzogerung steht, stabil ist und gleichzeitig auch 
eine stabile Invertierung aufweist, d.h. daft es ein 
Minimalphasensystem ist. Dartiber hinaus ist angenommen, dafi die 
Eingangssignale Zl{t) und Z2(t) (beispielsweise ein Sprach- 
bzw, ein Rauschsignal) statistisch voneinander unabhangig sind 
und nicht gaussf ormig verteilt sind. Die Menge XI (t) und X2 (t) 
der uberlagerten Eingangssignale Zl(t) und Z2(t) sind 
Eingangssignale in ein Entmischsystem mit einer Entmischmatrix 
M(q), deren Parameter (Matrixelemente) auf eine Maximierung der 
statistischen Unabhangigkeit zwischen den Ausgangssignalen 
Yl(t) und Y2(t) trainiert werden. Unter „Trainieren" ist dabei 
der gut bekannte Lernvorgang beispielsweise eines neuronalen 
Netzes bekannt, das als ein Beispiel fur eine Technik genannt 
sein soil, die statistische Unabhangigkeit zu maximieren. Dies 
erfolgt durch Minimierung einer im weiteren beschriebenen 
Kostenfunktion J(M) . 

Es wird eine Kumulanten-Kostenf unktion gebildet, die die 
Diagonalkumulantenelementen der Kumulantenordnung 2-4 
minimiert : 

4 2 
Dcum w J(M) =2] J] Jc^^^nondiagj 
i = l nondiag 

Folgende Gesichtspunkte der dynamischen Mischung durch die 
Mischmatrix S (q) sind dabei zu beriicksichtigen : 
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Stabilitat des Entmischsystems : 
Dies wird erreicht, wenn M(q) auf eine finite 
Impulsantantwort (FIR-Filter) beschrankt wird. Die 
Stabilitat des FIR-Systems M(q) kann dariiber hinaus auch 
dadurch erhalten warden, daft wahrend der Lernphase eine 
Projektion in den Einheitskreis erfolgt Eine 
moglicherweise vorliegende Nichtkausalitat der 
Invertierung von S (q) kann durch eine geeignete 
Zeitverschiebung (Verzogerung) des Eingangssignals X(t) 
kompensiert werden. 

Eindeutigkeit der getrennten Signale Y(t): 
Ftir den Fall statischer Mischungen werden die 
ursprtinglichen Quellsignale durch eine Skalierung 
wiedergewonnen. Fiir den Fall einer dynamischen Entmischung 
ist die Gefahr einer Nichteindeutigkeit der getrennten 
Signale Y(t) sogar noch grofier. Es ist of f ensichtlich, dafi 
fiir den Fall, dali Yl(t) und Y2 (t) statistisch voneinander 
unabhangig sind, auch jegliche linear gefilterte 
Modifikation dieser Signale immer noch statistisch 
unabhangig sind. Daher ist eine zusatzliche Information 
notwendig, urn die inharente Nichteindeutigkeit des 
Problems zu verringern. 

Gaussverf ormung der Daten: 

Algorithmen auf Kumulantenbasis fiir eine statische Blind 
Source-Trennung minimieren bzw. eliminieren in effektiver 
Weise Diagonalkumulanten hoherer Ordnung entsprechend den 
Ausgangssignalen Y{t). Andererseits fiihrt eine lineare 
Filterung zu einer Gaussverteilungs-Verf ormung der Daten, 
bei denen die Kumulanten hoherer Ordnung in Richtung 0 
gehen. Dies kann daher zu Randlosungen fiahren, in denen 
die Kostenfunktion ein lokales Minimum erreicht, wobei die 
erwunschte eigentliche Trennung (globales Minimum) nicht 
erfolgt. Um diesen ungewtinschten Fall zu vermeiden, wird 
die Struktur der Entmisch-Transf erf unktion 

(Entmischmatrix) M(q) einigen Beschrankungen unterworfen. 
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Um die obengenannten Probleme zu umgehen, wird ein Ansatz 
gewahlt, dafi wenigstens eines (oder auch alle) der 
Diagonalelemente auf den Einheitswert gesetzt werden: 

Mil (q) = 1 

und 

M22(q) = 1. 

Diese Annahme ist exakt, wenn die Mischelemente Sll (q) und/oder 
S22(q) ebenfalls einen Einheitswert „1" aufweisen. Sonst sei 
angenommen, dafi Sll (q) und/oder S22 (q) stabile Invertierungen 
aufweisen, was die Skalierung der Diagonalelemente von M(q) auf 
den Einheitswert erlaubt. Dieser Ansatz verringert wesentlich 
die Nichteindeutigkeit einer Losung und vermeidet dariiber 
hinaus in effektiver Weise die Gefahr einer iibermaBigen 
Gaussverteilungs-Verf ormung der Ausgangssignale . Auch wenn auf 
den ersten Blick die Beschrankung der Diagonalelemente von 
M(q) , wie oben ausgefuhrt, sehr restriktiv wirkt, ist diese 
Annahme in der praktischen Anwendung in der Kegel erfullt. Ein 
typisches Beispiel ist die Entrauschung von Sprachsignalen auf 
der Grundlage einer Aufzeichnung mit zwei Mikrofonen, wobei die 
Mikrofone voneinander raumlich getrennt sind oder ein Mikrofon 
in Richtung des Sprechers gerichtet ist, wahrend das andere 
Mikrofon in der umgekehrten Richtung gerichtet ist, so dali das 
zweite, von dem Sprecher abgewandte Signal im wesent lichen nur 
ein Rauschsignal auf nimmt . 

Der Kumulantenansatz basiert auf einer direkten Ermittlung der 
Diagonalkumulanten, wie sie in dem eingangs genannten Artikel 
von F. Ehlers und H, Schuster, „Blind Separation of convolutive 
mixtures and an application in automatic speech recognition" 
IEEE Trans. Signal Proc. (1997), ausgefuhrt ist, was aber 
inharent den Nachteil aufweist, dali die numerische Losung sehr 
aufwendig ist. Daher wird eine geeignete Initialisierung dieses 
Minimierungsverf ahrens verwendet . Um Startwerte fur das 
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Minimierungsverfahren zu ermitteln, wird gemaft der vorliegenden 
Erfindung die Technik der zeitverzogerten Dekorrelation (TDD) 
zur gleichzeitigen Dekorrelierung zweier verschiedener 
Zeitverzogerungen angewendet, wobei diese TDD-Technik sich auf 
ein geeignetes Matrix-Eigenwertproblem zuriickfuhren laBt. Wie 
bereits gesagt, wird diese TDD-Technik gemali der vorliegenden 
Erfindung zur Initiierung des Diagonal (Kreuzkorrelations ) - 
Kumulantenminimierungsproblems verwendet . 

Zusaramenf assend lalit sich das Verfahren in die folgenden beiden 
Schritte unterteilen: 

1. Wiederholung des TDD-Verf ahrens auf Grundlage des 
Eigenwertproblems im Frequenzbereich ftir verschiedene 
Verzogerungspaare und Ermittlung der Losung, bei der die 
Kreuzkorrelationsterme einen minimalen Wert aufweisen. 

2. Initiierung (Start) der Diagonal-Kumulantenminimierung auf 
Grundlage der im oben genannten Schritt ermittelten 
Startwerte ( FIR-Parameter ) . 

Im folgenden sollen noch einige Haupteigenschaf ten und Vorteiie 
noch einmal zusammengef afit werden: 

- Es ist kein a-priori-Wissen der Signaleigenschaf ten 
notwendig, mit der Ausnahme, dali eine statistische 
Unabhangigkeit gefordert wird. 

- Die Stabilitat des dynamischen Entmischsystems wird durch 
die Modulierung seiner Komponenten als FIR-Filter 
gewahrleistet . 

- Eine iibermaBige Gaussverteilung-Verf ormung wird durch den 
Ansatz vermieden, dafi wenigstens eines der Elemente der 
Mischtransf er-Funktionsmatrix (Entmischmatrix) auf den 
Einheitswert gesetzt wird bzw. auf den Einheitswert 
skaliert werden kann, und 
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- da der Kumulanten-Minimierungsschritt (Schritt 2) einen 
hohen Rechenauf wand erfordert, wird der Lernalgorithmus 
beispielsweise eines neuronalen Netzes durch das TDD- 
Verfahren initialisiert . 
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Im weiteren ist ein Prograiran in Matlab, Version 4 Oder Version 
angegeben, mit dem das oben beschriebene Ausfuhrungsbeispiel 
auf einem Rechner realisiert warden kann: 

function [ cost , out 1 , out2 ] =cuinulant_cost FIRa2 (par , input , pi , pll , 
p2,p22,a3,a4) ; 

% [cost, outl, out2] =cumulant_costFIRa2 (par, input,pl,pll,p2,p22, 
a3,a4) ; 

% cumulant cost 

% FIR representation used 

% filter function used in both directions (non_causal) 

[np,mp] =size (par) ; 
f irl=par ( 1 : pi) ; 
firll=par (l+pl:pl+pll) ; 
fir2=par (1+pl+pll :pl+pll+p2) ; 
fir22=par (pl+pll+p2+l:mp) ; 

den=l; %FIR only 

outl= [input ( : ; 1) -filter (f irl, den, input ( : , 2) ) -f lipud ( filter 
([0 firll ] , [den] , flipud(input ( : ,2) ) ) ) ] ; 

%/std (input (1, :)) ; %dlsim 

%filter 

out2= [input ( : , 2) -f ilter ( f ir2 , den, input ( : , 1) ) -f lipud ( filter 
([0 fir22 ], [den] ,f lipud (input (:,1) )))]; %/std (input (:, 2) ) ; 

%dlsiin %filter 

out= [outl out2] ; 

%outl=outl/std (outl) ; % this scaling was not needed in examples 
in SIP98 paper 
%out2=out2/std (out2) ; 

Ld=0; % number of delays in calculating the cross-correlation 

cost3=0; 

cost4=0; 
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costALLl=[] ; 
costALL2= [ ] ; 
ol2=outl. *out2; 
cost2=mean{ol2) '^2; 

oll2=outl. *outl. *out2; 
ol22=outl. *out2.*out2; 

if a3 ==1 

cost3=[mean(ol22) ] ^2+ [mean (ol22) ]^2; 

end 

if a4 ==1 

cost4= [mean (oll2 . *outl) -3*mean (outl . ^2) *mean (ol2 ) ] 
[mean( (outl. ^2) .* (out2.^2) ) -2*mean (ol2 ) ^2- 
mean{outl."2)*mean(out2."2) ]^2+. . . 
[inean(ol22.*out2) -3*mean(out2.^2) *mean{ol2) ] ^2; 

end 

%cum4a= [cum4x (outl, outl, outl, outl) ] "^2; 
%cum4b= [cuin4x (out2 , out2 , out2 , out2 ) ] ^2; 



cost=cost2+a3*cost3+a4*cost4; 



%-cum4a-cum4b; 
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Patentanspruche 

1. Verfahren zur Ermittlung von Parametern eines technischen 
Systems, mit dem Ausgangssignale aus einer Menge uberlagerter , 
statistisch voneinander unabhangiger Eingangssignale ermittelt 
warden konnen, bei dem die Parameter derart ermittelt werden, 
daft die statistische Unabhangigkeit der Ausgangssignale 
maximiert wird. 

2. Verfahren nach Anspruch 1, 

bei dem die Parameter in einem iterativen Verfahren ermittelt 
werden. 

3. Verfahren nach Anspruch 1 oder 2, 

bei dem die Parameter Elemente einer Entmischmatrix sind, mit 
der die Menge der uberlagerten Eingangssignale multipliziert 
wird, wodurch die Ausgangssignale gebildet werden. 

4. Verfahren nach Anspruch 3, 

bei dem die Optimierung der Parameter der Entmischmatrix durch 
die folgenden Schritte erhalten wird: 

- Wiederholung einer zeitverzogerten Dekorrelationsberechnung 
(6) zur Ermittlung der Eigenwerte der Entmischmatrix, 

- Ermittlung der Eigenwerte der Entmischmatrix, fiir die 
Kreuzkorrelationen einen minimalen Wert annehmen, und 

- Ausfuhrung einer Kuraulantenminimierung (5) , wobei als 
Startwerte fur die Kumulantenminimierung die im vorherigen 
Schritt ermittelten Eigenwerte verwendet" werden. 

5. Verfahren nach Anspruch 4, 

bei dem die Kumulantenminimierung durch Trainieren eines 
neuronalen Netzes (5) erfolgt. 



6. Verfahren nach einem der Anspriiche 3 bis 5, 
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bei dem bei der Optimierung der Parameter der Entmischmatrix 
wenigstens ein Diagonalparameter der Entmischmatrix auf einen 
vorgegebenen Wert gesetzt wird. 

7. Verfahren nach einem der Ansprtiche 3 bis 6, 

bei dem die Entmischmatrix auf eine finite Impulsantwort 
begrenzt wird. 

8. Verfahren nach einem der Ansprtiche 3 bis 1, 

bei dem die Entmischmatrix wahrend der Kumulantenminimierung 
(5) durch Projektion in einen Einheitskreis stabilisiert wird. 

9. Verfahren nach einem der Anspruche 1 bis 8, eingesetzt zur 
Trennung uberlagerter, statistisch voneinander unabhangiger 
Eingangssignale . 

10. Verfahren nach einem der Anspruche 1 bis 8, eingesetzt zur 
Trennung iiberlagerter , statistisch voneinander unabhangiger 
akustischer Eingangssignale. 

11. Anordnung zur Ermittlung von Parametern eines technischen 
Systems, mit dem Ausgangssignale aus einer Menge uberlagerter , 
statistisch voneinander unabhangiger Eingangssignale ermittelt 
werden konnen, mit einem Prozessor, der derart eingerichtet 
ist, dafi> die Parameter derart ermittelt werden konnen, daft die 
statistische Unabhangigkeit der Ausgangssignale maximiert wird- 

12. Anordnung nach Anspruch 11, 

bei der der Prozessor derart eingerichtet ist, dali die 
Parameter in einem iterativen Verfahren ermittelt werden. 

13. Anordnung nach Anspruch 11 oder 12, 

bei der der Prozessor derart eingerichtet ist, dafi die 
Parameter Elemente einer Entmischmatrix sind, mit der die Menge 
der uberlagerten Eingangssignale multipliziert wird, wodurch 
die Ausgangssignale gebildet werden. 
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14. Anordnung nach Anspruch 13, 

bei der der Prozessor derart eingerichtet ist, daR die 
Optimierung der Parameter der Entmischmatrix durch die 
folgenden Schritte erhalten wird: 

- Wiederholung einer zeitverzogerten Dekorrelationsberechnung 
(6) zur Ermittlung der Eigenwerte der Entmischmatrix, 

- Ermittlung der Eigenwerte der Entmischmatrix, fur die 
Kreuzkorrelationen einen minimalen Wert annehmen, und 

- Ausftihrung einer Kumulantenminimierung (5), wobei als 
Startwerte fur die Kumulantenminimierung die im vorherigen 
Schritt ermittelten Eigenwerte verwendet werden. 

15. Anordnung nach Anspruch 14, 

bei der der Prozessor derart eingerichtet ist, daft die 
Kumulantenminimierung durch Trainieren eines neuronalen Netzes 
(5) erfolgt. 

16. Anordnung nach einem der Anspruche 13 bis 15, 

bei der der Prozessor derart eingerichtet ist, daft bei der 
Optimierung der Parameter der Entmischmatrix wenigstens ein 
Diagonalparameter der Entmischmatrix auf einen vorgegebenen 
Wert gesetzt wird. 

17. Anordnung nach einem der Anspruche 13 bis 16, 

bei der der Prozessor derart eingerichtet ist, daJi die 
Entmischmatrix auf eine finite Impulsantwort begrenzt wird. 

18. Anordnung nach einem der Anspruche 13 bis 17, 

bei der der Prozessor derart eingerichtet ist, daii die 
Entmischmatrix wahrend der Kumulantenminimierung (5) durch 
Projektion in einen Einheitskreis stabilisiert wird. 

19. Anordnung nach einem der Anspruche 11 bis 18, eingesetzt 
zur Trennung iiberlagerter, statistisch voneinander unabhangiger 
Eingangssignale . 
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20. Anordnung nach einem der Anspriiche 11 bis 18, eingesetzt 
zur Trennung iiberlagerter, statistisch voneinander unabhangiger 
akustischer Eingangssignale, 
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Zusammenfas sung 

Verfahren und Anordnung zur Ermittlung von Par ame tern eines 
technischen Systems 

Es werden Parameter eines technischen Systems, mit dem 
Ausgangssignale aus einer Menge uberlagerter , statistisch 
voneinander unabhangiger Eingangssignale ermittelt werden 
konnen, bestimmt. Die Parameter werden derart ermittelt, daB 
die statistische Unabhangigkeit der Ausgangssignale maximiert 
wird. 
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Declaration and Power of Attorney For Patent Application 
Erklarung Fur Patentanmeldungen Mit Vollmacht 

German Language Declaration 



Als nachstehend benannter Erfinder erklare ich hiermit 
an Eides Start: 



dass mein Wohnsitz, meine Postanschrift, und meine 
Staatsangehorigkeit den im Nachstehenden nach 
meinem Namen aufgefUhrten Angaben entsprechen, 



dass ich, nach bestem Wissen der ursprungliche, 
erste und alleinige Erfinder (falls nachstehend nur ein 
Name angegeben ist) oder ein ursprtinglicher, erster 
und Miterflnder (falls nachstehend mehrere Namen 
aufgefuhrt sind) des Gegenstandes bin, fur den dieser 
Antrag gestellt wird und fur den ein Patent beantragt 
wird fur die Erfindung mit dem Titel: 



Signaltrennunqsverfahren 



und 



anordnung fur nichtlineare Mischungen 
unbekannter Signale 



deren Beschreibung 

(zutreffendes ankreuzen) 
□ hier beigefugt ist. 

am 14.10.1999 als 
PCT Internationale Anmeldung 

PCT Anmeldungsnummer PCTyDE99/03304 

eingereicht wurde und am 

abgeandert wurde (falls tatsachlich abgeandert). 



Ich bestatige hiermit, dass ich den Inhalt der obigen 
Patentanmeldung einschliesslich der Anspruche 
durchgesehen und verstanden habe, die eventuell 
durch einen Zusatzantrag wie oben erwahnt abgean- 
dert wurde. 



Ich erkenne meine Pflicht zur Offenbarung irgendwel- 
cher Informationen, die fiir die Prufung der vorliegen- 
den Anmeldung in Einklang mit Absatz 37, Bundes- 
gesetzbuch. Paragraph 1.56(a) von Wichtigkeit sind. 



Ich beanspruche hiermit auslSndische Prioritatsvorteile 
gemass Abschnitt 35 der Zivilprozessordnung der 
Vereinigten Staaten, Paragraph 119 aller unten ange- 
gebenen Auslandsanmeldungen fur ein Patent oder 
eine Erfindersurkunde, und habe auch alle Auslands- 
anmeldungen fur ein Patent oder eine Erfindersurkun- 
de nachstehend gekennzeichnet, die ein Anmelde- 
datum haben, das vor dem Anmeldedatum der 
Anmeldung liegt, fur die Priorltat beansprucht wird. 



Form PTO-FB-240 (8-83) 



As a below named inventor, I hereby declare that: 



My residence, post office address and citizenship are 
as stated below next to my name. 



I believe I am the original, first and sole inventor (if 
only one name is listed below) or an original, first and 
joint inventor (if plural names are listed below) of the 
subject matter which is claimed and for which a patent 
is sought on the invention entitled 



Signal separation method and device for 
non-linear mixing of unknown signals 



the specification of which 

(check one) 
□ is attached hereto. 
S was filed on 14.10.1999 as 
PCT international application 
PCT Application No. POT/DE99/03304 
and was amended on _ 



(if applicable) 



I hereby state that I have reviewed and understand the 
contents of the above identified specification, including 
the claims as amended by any amendment referred to 
above. 



i acknowledge the duty to disclose information which 
is material to the examination of this application in 
accordance with Title 37, Code of Federal 
Regulations, §1 .56(a). 



I hereby claim foreign priority benefits under Title 35, 
United States Code, §1 1 9 of any foreign application(s) 
for patent or inventor's certificate listed below and 
have also identified below any foreign application for 
patent or inventor's certificate having a filing date 
before that of the application on which priority is 
claimed: 



Patent and Trademark Office-U.S. DEPARTMENT OF COMMERCE 



Prior foreign appplications 
Prioritat beansprucht 



19849549.8 DE 
(Number) (Country) 
(Nummer) (Land) 



(Number) 
(Nummer) 



(Number) 
(Nummer) 



(Country) 
(Land) 



(Country) 
(Land) 



German Language Declaration 



27.10.1998 

(Day Month Year Filed) 
(Tag Monat Jaiir eingereicint) 



(Day Month Year Filed) 
(Tag Monat Jahr eingereicht) 



(Day Month Year Filed) 
(Tag Monat Jahr eingereicht) 



Priority Claimed 



□ 
No 
Nein 



□ 
Yes 



□ 
Yes 



□ 
No 
Nein 



ich beanspruche hiermit gemass Absatz 35 der Zivil- 
prozessordnung der Vereinigten Staaten, Paragraph 
120, den Vorzug ailer unten aufgefiihrten Anmel- 
dungen und falls der Gegenstand aus jedem Anspruch 
dieser Anmeldung nicht in einer friiheren 
amerikanischen Patentanmeidung laut dem ersten 
Paragraphen des Absatzes 35 der ZlvilprozeUordnung 
der Vereinigten Staaten, Paragraph 122 offenbart ist, 
erl<enne ich gemass Absatz 37, Bundesgesetzbuch, 
Paragraph 1 .56(a) meine Pflicht zur Offenbarung von 
Informationen an, die zwischen dem Anmeldedatum 
der friiheren Anmeldung und dem nationalen oder 
PCT internationalen Anmeldedatum dieser Anmeldung 
bekannt geworden sind. 



PCT/DE99/03304 
(App)ication Serial No.) 
(Anmeldeseriennummer) 



I hereby claim the benefit under Title 35. United States 
Code. §120 of any United States application(s) listed 
below and, insofar as the subject matter of each of the 
claims of this application is not disclosed in the prior 
United States application in the manner provided by 
the first paragraph of Title 35, United States Code, 
§122, I acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal 
Regulations, §1. 56(a) which occured between the 
filing date of the prior application and the national or 
PCT international filing date of this application. 



(Status) 

(patentiert, anhangig, 
aufgegeben) 



(Status) 

(patented, pending, 
abandoned) 



(Status) 

(patentiert, antiangig, 
aufgeben) 



(Status) 

(patented, pending, 
abandoned) 



Ich erklare hiermit, dass alle von mir in der vorliegen- 
den Erklarung gemachten Angaben nach meinem 
besten Wissen und Gewissen der vollen Wahrheit 
entsprechen, und dass ich diese eidesstattliche Erkla- 
aing in Kenntnis dessen abgebe, dass wissentlich und 
vorsatzlich falsche Angaben gemass Paragraph 1001, 
Absatz 18 der Zivilprozessordnung der Vereinigten 
Staaten von Amerlka mit Geldstrafe belegt und/oder 
Gefangnis bestrafl werden koennen, und dass derartig 
wissentlich und vorsatzlich falsche Angaben die Gul- 
tigkeit der vorliegenden Patentanmeidung Oder eines 
darauf erteilten Patentes gefShrden konnen. 



I hereby declare that all statements made herein of my 
own knowledge are true and that all statements made 
on information and belief are believed to be true, and 
further that these statements were made with the 
knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may 
jeopardize the validity of the application or any patent 
issued thereon. 
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Patent and Trademarl? Office-U.S. DEPARTMENT OF COMMERCE 
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VERTRETUNGSVOLLMACHT: Als benannter Erfinder 
beauftrage ich hiermit den nachstehend benannten 
Patentanwalt (oder die nachstehend benannten 
PatentanwSlte) und/oder Patent-Agenten mit der 
Verfolgung der vorliegenden Patentanmeldung sowie 
mit der Abwicklung alier damit verbundenen Geschafte 
vor dem Patent- und Warenzeichenamt: (Name und 
Registrationsnummer anfuhren) 



POWER OF ATTORNEY: As a named inventor, I 
hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all 
business in the Patent and Trademarl< Office 
connected therewith, (list name and registration 
number) 



Customer No. 21171 



Telefongesprache bitte richten an: 
(Name und Telefonnummer) 



Direct Telephone Calls to: (name and telephone 
number) 



Send Correspondence to: 




Voller Name des einzigen oder urspriinglichen Erfinders: 

Dr. DRAGAN OBRADOVIC 


Full name of sole or first inventor: 

Dr. DRAGAN OBRADOVIC 


Unterschrift des Erfinders Datum ^ 


Inventor's signature 


Date 


MUENCHEN, DEUTSCHLAND 


Residence 

MUENCHEN, GERMANY 




Staatsangehdngkeit 


Citizenship 

DE^ / T 


Postanschrift 

FRANZISKANERSTRASSE 28 


Post Office Addess 

FRANZISKANERSTRASSE 28 


81669 MUENCHEN 


81669 MUENCHEN 


Voller Name des zweiten Miterflnders (falls zutreffend): 




Unterschrift des Erfinders Datum 


Second Inventor's signature 




Wotinsifz 


Residence 


Staatsangehorlgkeit 


Citizenship 


Postanschrift 


Post Office Address 







(Bitte entsprechende Informationen und Unterschriften im 
Falle von dritten und weiteren Miterfindern angeben). 



(Supply similar information and signature for third and 
subsequent joint inventors). 
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